2026-01-28 20:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 20:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 20:00:06 [ayvens.be] INFO: Starting spider ayvens.be
2026-01-28 20:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 20:00:07 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 20:00:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 20:00:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 20:00:07 [scrapy.extensions.telnet] INFO: Telnet Password: 780ae6a591f6e796
2026-01-28 20:00:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 20:00:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.be/task_72_2026-01-28T20_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 20:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 20:00:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 20:00:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 20:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-28 20:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 20:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 20:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-01-28 20:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-01-28 20:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 20:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 20:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 20:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 20:00:07 [scrapy.core.engine] INFO: Spider opened
2026-01-28 20:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-01-28 20:00:07 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:07 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:12 [scrapy-playwright] INFO: Launching browser firefox
2026-01-28 20:00:13 [scrapy-playwright] INFO: Browser firefox launched
2026-01-28 20:00:13 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-01-28 20:00:13 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-01-28 20:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4QVFFAQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7YT6ABHA.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WFA2IVWG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LVJXO4QX.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2N74OY7W.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KZOV2SQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-P3E7UHUI.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WE77U2QS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-O3OWKDIN.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WFA2IVWG.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7YT6ABHA.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4QVFFAQG.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2N74OY7W.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LVJXO4QX.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KZOV2SQ2.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-P3E7UHUI.js>
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3HJTOVT5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-G7VKZLNV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-IOF7VMBJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PGNL7WWW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RQLFCBMH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-S5E5FHXZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGXSF4AK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-LVJXO4QX.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5HD3KQV3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FB6RKR5I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ALI5XYZJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LHCNJE3I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7C2GTJ24.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WE77U2QS.js>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-O3OWKDIN.js>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CMYMW4RH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-276SS4TV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7KVSNWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OION63CA.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NO5FJ6IE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJGQXDQB.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MADFXCQX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-57LOL62V.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JK3VA6V3.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ECZFIAAV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RWL6TUXQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3ZRJENLY.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-35VRT2WM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WJPXCSUZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-GWHLDUVT.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LYOOO25D.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7LLFTWQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:17 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3HJTOVT5.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-G7VKZLNV.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PGNL7WWW.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-IOF7VMBJ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RQLFCBMH.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-S5E5FHXZ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGXSF4AK.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5HD3KQV3.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FB6RKR5I.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ALI5XYZJ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LHCNJE3I.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7C2GTJ24.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CMYMW4RH.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-276SS4TV.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7KVSNWE.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OION63CA.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NO5FJ6IE.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJGQXDQB.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MADFXCQX.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JK3VA6V3.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-57LOL62V.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ECZFIAAV.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RWL6TUXQ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3ZRJENLY.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-35VRT2WM.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WJPXCSUZ.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-GWHLDUVT.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7LLFTWQ2.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LYOOO25D.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HLMVA2XG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HLMVA2XG.js>
2026-01-28 20:00:18 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7WQD6B5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HLMVA2XG.js)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7WQD6B5.js>
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7P3LAPEA.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7P3LAPEA.js>
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6TCU7CUH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-TXAFC7UM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:19 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MIPFLQ72.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6TCU7CUH.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJDFUE4N.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPJAYUCB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MIPFLQ72.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-TXAFC7UM.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OIQIERBW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-UFB65P4A.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NTG4JAHX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7TECJER3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJDFUE4N.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPJAYUCB.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OIQIERBW.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-UFB65P4A.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NTG4JAHX.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7TECJER3.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K3XLXP2R.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HBBQKHO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-UFB65P4A.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HXFSIYAP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QMSFYIWN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K3XLXP2R.js>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HBBQKHO4.js>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HXFSIYAP.js>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VZKIXU23.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EOYYGPOY.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QMSFYIWN.js>
2026-01-28 20:00:21 [ayvens.be] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'jUBsPfXebUsh5yW59e6+qa|2026-01-28T20:00:18.273Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1801166418, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': '2Iuw1LFieTZbvSetXeiVve|1769630420471|1769630420471', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1769632220, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-01-28 20:00:21 [ayvens.be] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'jUBsPfXebUsh5yW59e6+qa|2026-01-28T20:00:18.273Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': '2Iuw1LFieTZbvSetXeiVve|1769630420471|1769630420471', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-01-28 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-01-28 20:00:21 [ayvens.be] INFO: Intercepting token...
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VZKIXU23.js>
2026-01-28 20:00:21 [ayvens.be] INFO: Scrolling element to trigger lazy load...
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6YCHXE2J.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:21 [ayvens.be] INFO: GraphQL headers: {'host': 'api.aldcarmarket.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'cross-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9QdGpxbi1jYy1FVTpLSks1eEVqSGtGek1GOFRBWEJoek1NckV5dFVYamZ1ZnhYQ0YzOFQ3ejMwNGo5TmtqRDJGNnhTdzdqNGRBdGFE', 'connection': 'keep-alive'}
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/camera-icon.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/se.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/dk.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:21 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MSBSCS6P.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api.aldcarmarket.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EOYYGPOY.js>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6YCHXE2J.js>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/lu.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LMJCIPKN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7TECJER3.js)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/camera-icon.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/se.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/dk.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MSBSCS6P.js>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-T4CT3E3U.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MSBSCS6P.js)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/lu.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LMJCIPKN.js>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-T4CT3E3U.js>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-01-28 20:00:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:23 [ayvens.be] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-01-28 20:00:23 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-01-28 20:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:00:26 [ayvens.be] INFO: Found listing with ID: 1878037
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878037%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [ayvens.be] INFO: Scrape type for 1878037: 1
2026-01-28 20:00:26 [ayvens.be] INFO: Extracting data for car ID: 1878037
2026-01-28 20:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bbee0f2-03c8-54e8-8a88-f80d76b153be with identifier: 1878037
2026-01-28 20:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be with scrape type 1
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/1.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/2.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/3.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/4.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/5.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/6.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/7.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/8.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/9.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/10.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/11.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/12.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/13.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/14.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/15.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/16.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/17.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/18.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/19.jpg not downloaded yet
2026-01-28 20:00:26 [ayvens.be] INFO: Found listing with ID: 1878038
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878038%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [ayvens.be] INFO: Scrape type for 1878038: 1
2026-01-28 20:00:26 [ayvens.be] INFO: Extracting data for car ID: 1878038
2026-01-28 20:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d430d7f8-03c4-5407-af53-cf12d07b21de with identifier: 1878038
2026-01-28 20:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d430d7f8-03c4-5407-af53-cf12d07b21de with scrape type 1
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/1.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/2.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/3.jpg not downloaded yet
2026-01-28 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/4.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/5.jpg not downloaded yet
2026-01-28 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/6.jpg not downloaded yet
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/7.jpg not downloaded yet
2026-01-28 20:00:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7a10>
2026-01-28 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/1.jpg saved to cache
2026-01-28 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc9010>
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/4.jpg saved to cache
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/8.jpg not downloaded yet
2026-01-28 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/9.jpg not downloaded yet
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50250>
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/5.jpg saved to cache
2026-01-28 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de4b90>
2026-01-28 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/3.jpg saved to cache
2026-01-28 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/10.jpg not downloaded yet
2026-01-28 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/11.jpg not downloaded yet
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/12.jpg not downloaded yet
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0710>
2026-01-28 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/2.jpg saved to cache
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/13.jpg not downloaded yet
2026-01-28 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/14.jpg not downloaded yet
2026-01-28 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5550>
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/6.jpg saved to cache
2026-01-28 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26b90>
2026-01-28 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/7.jpg saved to cache
2026-01-28 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27590>
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/10.jpg saved to cache
2026-01-28 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/15.jpg not downloaded yet
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49910>
2026-01-28 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/9.jpg saved to cache
2026-01-28 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/16.jpg not downloaded yet
2026-01-28 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/17.jpg not downloaded yet
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1cc90>
2026-01-28 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/11.jpg saved to cache
2026-01-28 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9a250>
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/8.jpg saved to cache
2026-01-28 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5da90>
2026-01-28 20:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/12.jpg saved to cache
2026-01-28 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1c8d0>
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/13.jpg saved to cache
2026-01-28 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/18.jpg not downloaded yet
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4f710>
2026-01-28 20:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/15.jpg saved to cache
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/19.jpg not downloaded yet
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/20.jpg not downloaded yet
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6250>
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/16.jpg saved to cache
2026-01-28 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f513d0>
2026-01-28 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/14.jpg saved to cache
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [ayvens.be] INFO: Found listing with ID: 1878039
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878039%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [ayvens.be] INFO: Scrape type for 1878039: 1
2026-01-28 20:00:36 [ayvens.be] INFO: Extracting data for car ID: 1878039
2026-01-28 20:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f25b26-6acf-5207-a41b-9fa14891437a with identifier: 1878039
2026-01-28 20:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f25b26-6acf-5207-a41b-9fa14891437a with scrape type 1
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/1.jpg not downloaded yet
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/2.jpg not downloaded yet
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e51410>
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/2.jpg saved to cache
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/3.jpg not downloaded yet
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/4.jpg not downloaded yet
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/5.jpg not downloaded yet
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df86d0>
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/4.jpg saved to cache
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05ed0>
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/1.jpg saved to cache
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfc750>
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/5.jpg saved to cache
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/6.jpg not downloaded yet
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/7.jpg not downloaded yet
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69f50>
2026-01-28 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/8.jpg saved to cache
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3850>
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/10.jpg saved to cache
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b511d0>
2026-01-28 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/9.jpg saved to cache
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/8.jpg not downloaded yet
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/9.jpg not downloaded yet
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/10.jpg not downloaded yet
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de0fd0>
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/7.jpg saved to cache
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/11.jpg not downloaded yet
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/12.jpg not downloaded yet
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79290>
2026-01-28 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/15.jpg saved to cache
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0bd10>
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/14.jpg saved to cache
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def550>
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/12.jpg saved to cache
2026-01-28 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c01f50>
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/13.jpg saved to cache
2026-01-28 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def850>
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/11.jpg saved to cache
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/13.jpg not downloaded yet
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/14.jpg not downloaded yet
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/15.jpg not downloaded yet
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53ad0>
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/16.jpg saved to cache
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/16.jpg not downloaded yet
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/17.jpg not downloaded yet
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57f90>
2026-01-28 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/6.jpg saved to cache
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57550>
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/18.jpg saved to cache
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/18.jpg not downloaded yet
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/19.jpg not downloaded yet
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e58d10>
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/17.jpg saved to cache
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4af10>
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/20.jpg saved to cache
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52e50>
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/3.jpg saved to cache
2026-01-28 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4a610>
2026-01-28 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fc7a65045f9fb4df2b70c92009d151af8%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/19.jpg saved to cache
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d430d7f8-03c4-5407-af53-cf12d07b21de
2026-01-28 20:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d430d7f8-03c4-5407-af53-cf12d07b21de, skipping ID generation
2026-01-28 20:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d430d7f8-03c4-5407-af53-cf12d07b21de with scrape type 1
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d430d7f8-03c4-5407-af53-cf12d07b21de from tracking dictionaries
2026-01-28 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d430d7f8-03c4-5407-af53-cf12d07b21de sending to next pipeline
2026-01-28 20:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d430d7f8-03c4-5407-af53-cf12d07b21de, identifier: 1878038
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c26090>
2026-01-28 20:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/2.jpg saved to cache
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0610>
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/1.jpg saved to cache
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d430d7f8-03c4-5407-af53-cf12d07b21de with identifier: 1878038
2026-01-28 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d430d7f8-03c4-5407-af53-cf12d07b21de with identifier: 1878038
2026-01-28 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d430d7f8-03c4-5407-af53-cf12d07b21de spider: ayvens.be
2026-01-28 20:00:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d430d7f8-03c4-5407-af53-cf12d07b21de due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd430d7f8-03c4-5407-af53-cf12d07b21de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 57695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774863,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677809,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d430d7f8-03c4-5407-af53-cf12d07b21de/d430d7f8-03c4-5407-af53-cf12d07b21de_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/c7a65045f9fb4df2b70c92009d151af8/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878038%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [ayvens.be] INFO: Saving data for 1878038: {'created_time': 1769630447.003573, 'last_price_update_time': 1769630447.003584, 'auction_closing_time': 1770202800.0}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878038') HTTP/1.1" 204 0
2026-01-28 20:00:47 [ayvens.be] INFO: Found listing with ID: 1878040
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878040%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [ayvens.be] INFO: Scrape type for 1878040: 1
2026-01-28 20:00:47 [ayvens.be] INFO: Extracting data for car ID: 1878040
2026-01-28 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be439b62-5e53-5783-812d-41713137544a with identifier: 1878040
2026-01-28 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be439b62-5e53-5783-812d-41713137544a with scrape type 1
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/1.jpg not downloaded yet
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/2.jpg not downloaded yet
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/3.jpg not downloaded yet
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/4.jpg not downloaded yet
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/5.jpg not downloaded yet
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e63a10>
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/5.jpg saved to cache
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50f50>
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/4.jpg saved to cache
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/6.jpg not downloaded yet
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f15dd0>
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/3.jpg saved to cache
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7d010>
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/7.jpg saved to cache
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/7.jpg not downloaded yet
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/8.jpg not downloaded yet
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de93d0>
2026-01-28 20:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/10.jpg saved to cache
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1d590>
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/8.jpg saved to cache
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccfdd0>
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/6.jpg saved to cache
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/9.jpg not downloaded yet
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/10.jpg not downloaded yet
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99810>
2026-01-28 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/9.jpg saved to cache
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/11.jpg not downloaded yet
2026-01-28 20:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/12.jpg not downloaded yet
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/13.jpg not downloaded yet
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69090>
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/15.jpg saved to cache
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c244d0>
2026-01-28 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/13.jpg saved to cache
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73590>
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/19.jpg saved to cache
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32550>
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/11.jpg saved to cache
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/14.jpg not downloaded yet
2026-01-28 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5790>
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/12.jpg saved to cache
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de05d0>
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/14.jpg saved to cache
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3fed0>
2026-01-28 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/18.jpg saved to cache
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/15.jpg not downloaded yet
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/16.jpg not downloaded yet
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42490>
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/17.jpg saved to cache
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/17.jpg not downloaded yet
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/18.jpg not downloaded yet
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/19.jpg not downloaded yet
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/20.jpg not downloaded yet
2026-01-28 20:00:53 [ayvens.be] INFO: Found listing with ID: 1878041
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878041%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.be] INFO: Scrape type for 1878041: 1
2026-01-28 20:00:53 [ayvens.be] INFO: Extracting data for car ID: 1878041
2026-01-28 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eddda95-033c-5754-8faa-f85f1b7d75ba with identifier: 1878041
2026-01-28 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eddda95-033c-5754-8faa-f85f1b7d75ba with scrape type 1
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/1.jpg not downloaded yet
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cacf10>
2026-01-28 20:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/19.jpg saved to cache
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/2.jpg not downloaded yet
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f437d0>
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/2.jpg saved to cache
2026-01-28 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b408d0>
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/3.jpg saved to cache
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a6b050>
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/5.jpg saved to cache
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/3.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/4.jpg not downloaded yet
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28050>
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/1.jpg saved to cache
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05d50>
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F3bdb9034d21e4369986983d4e9846ed9%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/16.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b3f25b26-6acf-5207-a41b-9fa14891437a
2026-01-28 20:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3f25b26-6acf-5207-a41b-9fa14891437a, skipping ID generation
2026-01-28 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f25b26-6acf-5207-a41b-9fa14891437a with scrape type 1
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b3f25b26-6acf-5207-a41b-9fa14891437a from tracking dictionaries
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3f25b26-6acf-5207-a41b-9fa14891437a sending to next pipeline
2026-01-28 20:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b3f25b26-6acf-5207-a41b-9fa14891437a, identifier: 1878039
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cce650>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/6.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b3f25b26-6acf-5207-a41b-9fa14891437a with identifier: 1878039
2026-01-28 20:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b3f25b26-6acf-5207-a41b-9fa14891437a with identifier: 1878039
2026-01-28 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b3f25b26-6acf-5207-a41b-9fa14891437a spider: ayvens.be
2026-01-28 20:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b3f25b26-6acf-5207-a41b-9fa14891437a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b3f25b26-6acf-5207-a41b-9fa14891437a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 57755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 790504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 874606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 913988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3f25b26-6acf-5207-a41b-9fa14891437a/b3f25b26-6acf-5207-a41b-9fa14891437a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/3bdb9034d21e4369986983d4e9846ed9/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878039%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.be] INFO: Saving data for 1878039: {'created_time': 1769630457.242229, 'last_price_update_time': 1769630457.242241, 'auction_closing_time': 1770202800.0}
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878039') HTTP/1.1" 204 0
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/5.jpg not downloaded yet
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/6.jpg not downloaded yet
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d951d0>
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/4.jpg saved to cache
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/7.jpg not downloaded yet
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/8.jpg not downloaded yet
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52c90>
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/7.jpg saved to cache
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5fc90>
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/17.jpg saved to cache
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0c650>
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/11.jpg saved to cache
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/9.jpg not downloaded yet
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/10.jpg not downloaded yet
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b11c10>
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252Ff0119b8a70bf4ee99e6c74162b8b4ef5%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/18.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be
2026-01-28 20:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bbee0f2-03c8-54e8-8a88-f80d76b153be, skipping ID generation
2026-01-28 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be with scrape type 1
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bbee0f2-03c8-54e8-8a88-f80d76b153be from tracking dictionaries
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bbee0f2-03c8-54e8-8a88-f80d76b153be sending to next pipeline
2026-01-28 20:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6bbee0f2-03c8-54e8-8a88-f80d76b153be, identifier: 1878037
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27a10>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/10.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0bc50>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/8.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efed10>
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/9.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/11.jpg not downloaded yet
2026-01-28 20:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6bbee0f2-03c8-54e8-8a88-f80d76b153be with identifier: 1878037
2026-01-28 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6bbee0f2-03c8-54e8-8a88-f80d76b153be with identifier: 1878037
2026-01-28 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6bbee0f2-03c8-54e8-8a88-f80d76b153be spider: ayvens.be
2026-01-28 20:01:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6bbee0f2-03c8-54e8-8a88-f80d76b153be due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6bbee0f2-03c8-54e8-8a88-f80d76b153be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 87179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646565,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 845255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bbee0f2-03c8-54e8-8a88-f80d76b153be/6bbee0f2-03c8-54e8-8a88-f80d76b153be_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/f0119b8a70bf4ee99e6c74162b8b4ef5/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'vin': None,
 'year': 2020}
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878037%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [ayvens.be] INFO: Saving data for 1878037: {'created_time': 1769630460.800293, 'last_price_update_time': 1769630460.800303, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878037') HTTP/1.1" 204 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/12.jpg not downloaded yet
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/13.jpg not downloaded yet
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/14.jpg not downloaded yet
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/15.jpg not downloaded yet
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/16.jpg not downloaded yet
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/17.jpg not downloaded yet
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8d550>
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/14.jpg saved to cache
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/18.jpg not downloaded yet
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/19.jpg not downloaded yet
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c850>
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/16.jpg saved to cache
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb9950>
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/13.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6dc10>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/17.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de9710>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/15.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4ae50>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/12.jpg saved to cache
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a550>
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/18.jpg saved to cache
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec290>
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/19.jpg saved to cache
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/20.jpg not downloaded yet
2026-01-28 20:01:04 [ayvens.be] INFO: Found listing with ID: 1878042
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878042%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.be] INFO: Scrape type for 1878042: 1
2026-01-28 20:01:04 [ayvens.be] INFO: Extracting data for car ID: 1878042
2026-01-28 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb4172a-2180-5f1f-acb7-6d958ab13c1b with identifier: 1878042
2026-01-28 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b with scrape type 1
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/1.jpg not downloaded yet
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/2.jpg not downloaded yet
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/3.jpg not downloaded yet
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/4.jpg not downloaded yet
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/5.jpg not downloaded yet
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/6.jpg not downloaded yet
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/7.jpg not downloaded yet
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd550>
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Ffc31354bce7d444aae697a5b8a518fb6%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/20.jpg saved to cache
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item be439b62-5e53-5783-812d-41713137544a
2026-01-28 20:01:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be439b62-5e53-5783-812d-41713137544a, skipping ID generation
2026-01-28 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be439b62-5e53-5783-812d-41713137544a with scrape type 1
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item be439b62-5e53-5783-812d-41713137544a from tracking dictionaries
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be439b62-5e53-5783-812d-41713137544a sending to next pipeline
2026-01-28 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be439b62-5e53-5783-812d-41713137544a, identifier: 1878040
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/8.jpg not downloaded yet
2026-01-28 20:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be439b62-5e53-5783-812d-41713137544a with identifier: 1878040
2026-01-28 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be439b62-5e53-5783-812d-41713137544a with identifier: 1878040
2026-01-28 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: be439b62-5e53-5783-812d-41713137544a spider: ayvens.be
2026-01-28 20:01:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: be439b62-5e53-5783-812d-41713137544a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'be439b62-5e53-5783-812d-41713137544a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 42862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714989,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 817313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be439b62-5e53-5783-812d-41713137544a/be439b62-5e53-5783-812d-41713137544a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/fc31354bce7d444aae697a5b8a518fb6/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878040%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.be] INFO: Saving data for 1878040: {'created_time': 1769630464.981399, 'last_price_update_time': 1769630464.981412, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878040') HTTP/1.1" 204 0
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a6b210>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/4.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31050>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/1.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e638d0>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/3.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6510>
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/5.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4db50>
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/7.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/9.jpg not downloaded yet
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbcb50>
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/2.jpg saved to cache
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce84d0>
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/6.jpg saved to cache
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/10.jpg not downloaded yet
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/11.jpg not downloaded yet
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/12.jpg not downloaded yet
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/13.jpg not downloaded yet
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/14.jpg not downloaded yet
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/15.jpg not downloaded yet
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/16.jpg not downloaded yet
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/17.jpg not downloaded yet
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b68210>
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/10.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a6b1d0>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/13.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1b610>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/18.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c24210>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/9.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7fe90>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/12.jpg saved to cache
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70910>
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/11.jpg saved to cache
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/18.jpg not downloaded yet
2026-01-28 20:01:09 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 4 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaaa10>
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/19.jpg saved to cache
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2b090>
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/8.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/19.jpg not downloaded yet
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/20.jpg not downloaded yet
2026-01-28 20:01:10 [ayvens.be] INFO: Found listing with ID: 1878043
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878043%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [ayvens.be] INFO: Scrape type for 1878043: 1
2026-01-28 20:01:10 [ayvens.be] INFO: Extracting data for car ID: 1878043
2026-01-28 20:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1de0e5-00e9-566d-9b17-60cd00cb0513 with identifier: 1878043
2026-01-28 20:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1de0e5-00e9-566d-9b17-60cd00cb0513 with scrape type 1
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/1.jpg not downloaded yet
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/2.jpg not downloaded yet
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/3.jpg not downloaded yet
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/4.jpg not downloaded yet
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/5.jpg not downloaded yet
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/6.jpg not downloaded yet
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/7.jpg not downloaded yet
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/8.jpg not downloaded yet
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1ed10>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/16.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def490>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/17.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/9.jpg not downloaded yet
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6590>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/15.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24a90>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/2.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfc590>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/1.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/10.jpg not downloaded yet
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/11.jpg not downloaded yet
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de4e10>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/9.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccdd50>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/20.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2f8d0>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fe32bbb2768b84a098f0f98ac97a5efb7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/14.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8eddda95-033c-5754-8faa-f85f1b7d75ba
2026-01-28 20:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8eddda95-033c-5754-8faa-f85f1b7d75ba, skipping ID generation
2026-01-28 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eddda95-033c-5754-8faa-f85f1b7d75ba with scrape type 1
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8eddda95-033c-5754-8faa-f85f1b7d75ba from tracking dictionaries
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8eddda95-033c-5754-8faa-f85f1b7d75ba sending to next pipeline
2026-01-28 20:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8eddda95-033c-5754-8faa-f85f1b7d75ba, identifier: 1878041
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8eddda95-033c-5754-8faa-f85f1b7d75ba with identifier: 1878041
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8eddda95-033c-5754-8faa-f85f1b7d75ba with identifier: 1878041
2026-01-28 20:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8eddda95-033c-5754-8faa-f85f1b7d75ba spider: ayvens.be
2026-01-28 20:01:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8eddda95-033c-5754-8faa-f85f1b7d75ba due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8eddda95-033c-5754-8faa-f85f1b7d75ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 46861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 815192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8eddda95-033c-5754-8faa-f85f1b7d75ba/8eddda95-033c-5754-8faa-f85f1b7d75ba_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/e32bbb2768b84a098f0f98ac97a5efb7/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878041%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [ayvens.be] INFO: Saving data for 1878041: {'created_time': 1769630474.164258, 'last_price_update_time': 1769630474.16427, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878041') HTTP/1.1" 204 0
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/12.jpg not downloaded yet
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/13.jpg not downloaded yet
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d955d0>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/11.jpg saved to cache
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/14.jpg not downloaded yet
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/15.jpg not downloaded yet
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d94ed0>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/12.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61010>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/10.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0310>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/5.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/16.jpg not downloaded yet
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/17.jpg not downloaded yet
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96250>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/7.jpg saved to cache
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6a690>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/18.jpg saved to cache
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c68290>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/6.jpg saved to cache
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/18.jpg not downloaded yet
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/19.jpg not downloaded yet
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/20.jpg not downloaded yet
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7b50>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/8.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:17 [ayvens.be] INFO: Found listing with ID: 1878044
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878044%27 HTTP/1.1" 200 None
2026-01-28 20:01:17 [ayvens.be] INFO: Scrape type for 1878044: 1
2026-01-28 20:01:17 [ayvens.be] INFO: Extracting data for car ID: 1878044
2026-01-28 20:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ef2ecc-7067-57f1-b657-55fe4ae5266a with identifier: 1878044
2026-01-28 20:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a with scrape type 1
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/1.jpg not downloaded yet
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/2.jpg not downloaded yet
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15b90>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/1.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd33d0>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/20.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f23290>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/19.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/3.jpg not downloaded yet
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/4.jpg not downloaded yet
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/5.jpg not downloaded yet
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27950>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/16.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a450>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/17.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/6.jpg not downloaded yet
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/7.jpg not downloaded yet
2026-01-28 20:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5fe10>
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/7.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c09550>
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/8.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec610>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/9.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08110>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/11.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59d90>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/10.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/8.jpg not downloaded yet
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/9.jpg not downloaded yet
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/10.jpg not downloaded yet
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61d90>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/12.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/11.jpg not downloaded yet
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/12.jpg not downloaded yet
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6e690>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/6.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f41b50>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/13.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/13.jpg not downloaded yet
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/14.jpg not downloaded yet
2026-01-28 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/15.jpg not downloaded yet
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d531d0>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/14.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30ad0>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/5.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64990>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/15.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48190>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/17.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d53950>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/18.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/16.jpg not downloaded yet
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/17.jpg not downloaded yet
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b40b10>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/20.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/18.jpg not downloaded yet
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/19.jpg not downloaded yet
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df6d50>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/16.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef38d0>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/19.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee5d90>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/1.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:26 [ayvens.be] INFO: Found listing with ID: 1878045
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878045%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [ayvens.be] INFO: Scrape type for 1878045: 1
2026-01-28 20:01:26 [ayvens.be] INFO: Extracting data for car ID: 1878045
2026-01-28 20:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ade031a-59b4-5294-9e19-8d58e2bc4630 with identifier: 1878045
2026-01-28 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ade031a-59b4-5294-9e19-8d58e2bc4630 with scrape type 1
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/1.jpg not downloaded yet
2026-01-28 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/2.jpg not downloaded yet
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8ed0>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/3.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69390>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/2.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/3.jpg not downloaded yet
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/4.jpg not downloaded yet
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/5.jpg not downloaded yet
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f4d0>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/4.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0d590>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/4.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/6.jpg not downloaded yet
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/7.jpg not downloaded yet
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5d450>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/7.jpg saved to cache
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f06590>
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/6.jpg saved to cache
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/8.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/9.jpg not downloaded yet
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/10.jpg not downloaded yet
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40c50>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/10.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b301d0>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/8.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d95a90>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/5.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43b90>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/9.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75dd0>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/11.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/11.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/12.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/13.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/14.jpg not downloaded yet
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/15.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/16.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edb610>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/3.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/17.jpg not downloaded yet
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a650>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/14.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3c190>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/13.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c45990>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/19.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/18.jpg not downloaded yet
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/19.jpg not downloaded yet
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7f810>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/15.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e310>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/16.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8be7dd0>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/17.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea79d0>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/18.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:34 [ayvens.be] INFO: Found listing with ID: 1878046
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878046%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [ayvens.be] INFO: Scrape type for 1878046: 1
2026-01-28 20:01:34 [ayvens.be] INFO: Extracting data for car ID: 1878046
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced6cc09-ba64-5948-9e83-1a1bf4aa3112 with identifier: 1878046
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112 with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/1.jpg not downloaded yet
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/2.jpg not downloaded yet
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/3.jpg not downloaded yet
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/4.jpg not downloaded yet
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/5.jpg not downloaded yet
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/6.jpg not downloaded yet
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/7.jpg not downloaded yet
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/8.jpg not downloaded yet
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e141d0>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/4.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1ab90>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/1.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da7f50>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/5.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deba10>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/3.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f910>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/7.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/9.jpg not downloaded yet
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6250>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/2.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/10.jpg not downloaded yet
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51b10>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/8.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b114d0>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/6.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/11.jpg not downloaded yet
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/12.jpg not downloaded yet
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9ba10>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/11.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/13.jpg not downloaded yet
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/14.jpg not downloaded yet
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f617d0>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/10.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/15.jpg not downloaded yet
2026-01-28 20:01:39 [ayvens.be] INFO: Found listing with ID: 1878047
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878047%27 HTTP/1.1" 200 None
2026-01-28 20:01:39 [ayvens.be] INFO: Scrape type for 1878047: 1
2026-01-28 20:01:39 [ayvens.be] INFO: Extracting data for car ID: 1878047
2026-01-28 20:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c61820-5fce-5d60-895b-f21b44ee8a59 with identifier: 1878047
2026-01-28 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c61820-5fce-5d60-895b-f21b44ee8a59 with scrape type 1
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/1.jpg not downloaded yet
2026-01-28 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/2.jpg not downloaded yet
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de0750>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F857f50c45e1b46728d99fefe07124184%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/2.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa1de0e5-00e9-566d-9b17-60cd00cb0513
2026-01-28 20:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa1de0e5-00e9-566d-9b17-60cd00cb0513, skipping ID generation
2026-01-28 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1de0e5-00e9-566d-9b17-60cd00cb0513 with scrape type 1
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aa1de0e5-00e9-566d-9b17-60cd00cb0513 from tracking dictionaries
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa1de0e5-00e9-566d-9b17-60cd00cb0513 sending to next pipeline
2026-01-28 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: aa1de0e5-00e9-566d-9b17-60cd00cb0513, identifier: 1878043
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e610d0>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/12.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deb150>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/17.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0deaa10>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/14.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6310>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F93fa26c493b1400b8aa88688382dd0ad%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/12.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a
2026-01-28 20:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30ef2ecc-7067-57f1-b657-55fe4ae5266a, skipping ID generation
2026-01-28 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a with scrape type 1
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30ef2ecc-7067-57f1-b657-55fe4ae5266a from tracking dictionaries
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30ef2ecc-7067-57f1-b657-55fe4ae5266a sending to next pipeline
2026-01-28 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30ef2ecc-7067-57f1-b657-55fe4ae5266a, identifier: 1878044
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cedad0>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/9.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: aa1de0e5-00e9-566d-9b17-60cd00cb0513 with identifier: 1878043
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: aa1de0e5-00e9-566d-9b17-60cd00cb0513 with identifier: 1878043
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: aa1de0e5-00e9-566d-9b17-60cd00cb0513 spider: ayvens.be
2026-01-28 20:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: aa1de0e5-00e9-566d-9b17-60cd00cb0513 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'aa1de0e5-00e9-566d-9b17-60cd00cb0513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 91207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759001,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597357,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa1de0e5-00e9-566d-9b17-60cd00cb0513/aa1de0e5-00e9-566d-9b17-60cd00cb0513_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/857f50c45e1b46728d99fefe07124184/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878043%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [ayvens.be] INFO: Saving data for 1878043: {'created_time': 1769630502.105532, 'last_price_update_time': 1769630502.105546, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878043') HTTP/1.1" 204 0
2026-01-28 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30ef2ecc-7067-57f1-b657-55fe4ae5266a with identifier: 1878044
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30ef2ecc-7067-57f1-b657-55fe4ae5266a with identifier: 1878044
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 30ef2ecc-7067-57f1-b657-55fe4ae5266a spider: ayvens.be
2026-01-28 20:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 30ef2ecc-7067-57f1-b657-55fe4ae5266a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '30ef2ecc-7067-57f1-b657-55fe4ae5266a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 83554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611174,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 801000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 898780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707703,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ef2ecc-7067-57f1-b657-55fe4ae5266a/30ef2ecc-7067-57f1-b657-55fe4ae5266a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/93fa26c493b1400b8aa88688382dd0ad/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878044%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [ayvens.be] INFO: Saving data for 1878044: {'created_time': 1769630502.507854, 'last_price_update_time': 1769630502.507866, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878044') HTTP/1.1" 204 0
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/3.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/4.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a61890>
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/1.jpg saved to cache
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/5.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/6.jpg not downloaded yet
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c44710>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/19.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef2050>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/18.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24c10>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/2.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/7.jpg not downloaded yet
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/8.jpg not downloaded yet
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0d450>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/16.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46390>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/15.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69750>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/8.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/9.jpg not downloaded yet
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/10.jpg not downloaded yet
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/11.jpg not downloaded yet
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded650>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/7.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77dd0>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/9.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/12.jpg not downloaded yet
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/13.jpg not downloaded yet
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3ae90>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/11.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78ed0>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/6.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/14.jpg not downloaded yet
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/15.jpg not downloaded yet
2026-01-28 20:01:46 [ayvens.be] INFO: Found listing with ID: 1878048
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878048%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [ayvens.be] INFO: Scrape type for 1878048: 1
2026-01-28 20:01:46 [ayvens.be] INFO: Extracting data for car ID: 1878048
2026-01-28 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ebbd11f-439a-5ca5-99e2-abe488162c7c with identifier: 1878048
2026-01-28 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c with scrape type 1
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/1.jpg not downloaded yet
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0ced0>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/12.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3f210>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/5.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0dc10>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/10.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23fd0>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/2.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7090>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/14.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a850>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/15.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/2.jpg not downloaded yet
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/3.jpg not downloaded yet
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/4.jpg not downloaded yet
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/5.jpg not downloaded yet
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/6.jpg not downloaded yet
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de0150>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/1.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/7.jpg not downloaded yet
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/8.jpg not downloaded yet
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/9.jpg not downloaded yet
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed9b90>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/4.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1210>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/3.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96d90>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/4.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d237d0>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/13.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52a50>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/5.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f212d0>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/6.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd2d50>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F7c29f264b5694c2fbf93d1ab998daf65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/3.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ced6cc09-ba64-5948-9e83-1a1bf4aa3112, skipping ID generation
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112 with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ced6cc09-ba64-5948-9e83-1a1bf4aa3112 from tracking dictionaries
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ced6cc09-ba64-5948-9e83-1a1bf4aa3112 sending to next pipeline
2026-01-28 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ced6cc09-ba64-5948-9e83-1a1bf4aa3112, identifier: 1878046
2026-01-28 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ced6cc09-ba64-5948-9e83-1a1bf4aa3112 with identifier: 1878046
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ced6cc09-ba64-5948-9e83-1a1bf4aa3112 with identifier: 1878046
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ced6cc09-ba64-5948-9e83-1a1bf4aa3112 spider: ayvens.be
2026-01-28 20:01:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ced6cc09-ba64-5948-9e83-1a1bf4aa3112 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ced6cc09-ba64-5948-9e83-1a1bf4aa3112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 37727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681549,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ced6cc09-ba64-5948-9e83-1a1bf4aa3112/ced6cc09-ba64-5948-9e83-1a1bf4aa3112_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/7c29f264b5694c2fbf93d1ab998daf65/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878046%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [ayvens.be] INFO: Saving data for 1878046: {'created_time': 1769630512.558868, 'last_price_update_time': 1769630512.558881, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878046') HTTP/1.1" 204 0
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/10.jpg not downloaded yet
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/11.jpg not downloaded yet
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/12.jpg not downloaded yet
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/13.jpg not downloaded yet
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/14.jpg not downloaded yet
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/15.jpg not downloaded yet
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee90d0>
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/12.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f375d0>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/11.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/16.jpg not downloaded yet
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53590>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/8.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecf850>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/9.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/17.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ec90>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/7.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e390>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/10.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f52ad0>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fa154c81612b648789150b014871a965a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/13.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5ade031a-59b4-5294-9e19-8d58e2bc4630
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ade031a-59b4-5294-9e19-8d58e2bc4630, skipping ID generation
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ade031a-59b4-5294-9e19-8d58e2bc4630 with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5ade031a-59b4-5294-9e19-8d58e2bc4630 from tracking dictionaries
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ade031a-59b4-5294-9e19-8d58e2bc4630 sending to next pipeline
2026-01-28 20:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ade031a-59b4-5294-9e19-8d58e2bc4630, identifier: 1878045
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8490>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/15.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/18.jpg not downloaded yet
2026-01-28 20:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ade031a-59b4-5294-9e19-8d58e2bc4630 with identifier: 1878045
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ade031a-59b4-5294-9e19-8d58e2bc4630 with identifier: 1878045
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5ade031a-59b4-5294-9e19-8d58e2bc4630 spider: ayvens.be
2026-01-28 20:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5ade031a-59b4-5294-9e19-8d58e2bc4630 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ade031a-59b4-5294-9e19-8d58e2bc4630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 60508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 962506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 876368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ade031a-59b4-5294-9e19-8d58e2bc4630/5ade031a-59b4-5294-9e19-8d58e2bc4630_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/a154c81612b648789150b014871a965a/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878045%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [ayvens.be] INFO: Saving data for 1878045: {'created_time': 1769630515.636646, 'last_price_update_time': 1769630515.636658, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878045') HTTP/1.1" 204 0
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/19.jpg not downloaded yet
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f06710>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/1.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:55 [ayvens.be] INFO: Found listing with ID: 1878049
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878049%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [ayvens.be] INFO: Scrape type for 1878049: 1
2026-01-28 20:01:55 [ayvens.be] INFO: Extracting data for car ID: 1878049
2026-01-28 20:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e with identifier: 1878049
2026-01-28 20:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e with scrape type 1
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/1.jpg not downloaded yet
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/2.jpg not downloaded yet
2026-01-28 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e543d0>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/14.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/3.jpg not downloaded yet
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/4.jpg not downloaded yet
2026-01-28 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/5.jpg not downloaded yet
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74dd0>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/13.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2c110>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/2.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64850>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/3.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2d2d0>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F72229dd6444b4bed9cdbbbc082ee9049%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/15.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 60c61820-5fce-5d60-895b-f21b44ee8a59
2026-01-28 20:01:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60c61820-5fce-5d60-895b-f21b44ee8a59, skipping ID generation
2026-01-28 20:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c61820-5fce-5d60-895b-f21b44ee8a59 with scrape type 1
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 60c61820-5fce-5d60-895b-f21b44ee8a59 from tracking dictionaries
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60c61820-5fce-5d60-895b-f21b44ee8a59 sending to next pipeline
2026-01-28 20:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 60c61820-5fce-5d60-895b-f21b44ee8a59, identifier: 1878047
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c26dd0>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/7.jpg saved to cache
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 60c61820-5fce-5d60-895b-f21b44ee8a59 with identifier: 1878047
2026-01-28 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 60c61820-5fce-5d60-895b-f21b44ee8a59 with identifier: 1878047
2026-01-28 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 60c61820-5fce-5d60-895b-f21b44ee8a59 spider: ayvens.be
2026-01-28 20:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 60c61820-5fce-5d60-895b-f21b44ee8a59 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '60c61820-5fce-5d60-895b-f21b44ee8a59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 86531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60c61820-5fce-5d60-895b-f21b44ee8a59/60c61820-5fce-5d60-895b-f21b44ee8a59_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/72229dd6444b4bed9cdbbbc082ee9049/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878047%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [ayvens.be] INFO: Saving data for 1878047: {'created_time': 1769630518.617035, 'last_price_update_time': 1769630518.617044, 'auction_closing_time': 1770202800.0}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878047') HTTP/1.1" 204 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/6.jpg not downloaded yet
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/7.jpg not downloaded yet
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7310>
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/6.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/8.jpg not downloaded yet
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/9.jpg not downloaded yet
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9050>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/10.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/10.jpg not downloaded yet
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/11.jpg not downloaded yet
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e650>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/4.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23990>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/5.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d218d0>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/14.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/12.jpg not downloaded yet
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/13.jpg not downloaded yet
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/14.jpg not downloaded yet
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed88d0>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/8.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de0150>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/14.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52fd0>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/9.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c5a550>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/13.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/15.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/16.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/17.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/18.jpg not downloaded yet
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/19.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c26e10>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/16.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/20.jpg not downloaded yet
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4bad0>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/19.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:02 [ayvens.be] INFO: Found listing with ID: 1878050
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878050%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [ayvens.be] INFO: Scrape type for 1878050: 1
2026-01-28 20:02:02 [ayvens.be] INFO: Extracting data for car ID: 1878050
2026-01-28 20:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189c43f5-f63a-534c-84df-4844fb6493a1 with identifier: 1878050
2026-01-28 20:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189c43f5-f63a-534c-84df-4844fb6493a1 with scrape type 1
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/1.jpg not downloaded yet
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b10ed0>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/18.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51890>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/12.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69a10>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/17.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b52a50>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/15.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5d490>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/1.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/2.jpg not downloaded yet
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69e90>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/4.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/3.jpg not downloaded yet
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/4.jpg not downloaded yet
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/5.jpg not downloaded yet
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/6.jpg not downloaded yet
2026-01-28 20:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/7.jpg not downloaded yet
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/8.jpg not downloaded yet
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/9.jpg not downloaded yet
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/10.jpg not downloaded yet
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def9d0>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/6.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de3bd0>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/3.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3a10>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/7.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7850>
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/5.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/11.jpg not downloaded yet
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/12.jpg not downloaded yet
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3c050>
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/9.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f16810>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/8.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3c290>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/11.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c25150>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/12.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:07 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -2 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/13.jpg not downloaded yet
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/14.jpg not downloaded yet
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/15.jpg not downloaded yet
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/16.jpg not downloaded yet
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/17.jpg not downloaded yet
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/18.jpg not downloaded yet
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/19.jpg not downloaded yet
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/20.jpg not downloaded yet
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e507d0>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/15.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:08 [ayvens.be] INFO: Found listing with ID: 1878051
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878051%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [ayvens.be] INFO: Scrape type for 1878051: 1
2026-01-28 20:02:08 [ayvens.be] INFO: Extracting data for car ID: 1878051
2026-01-28 20:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 548af6aa-a894-53ec-97c4-25b21a3b99cf with identifier: 1878051
2026-01-28 20:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 548af6aa-a894-53ec-97c4-25b21a3b99cf with scrape type 1
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/1.jpg not downloaded yet
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dce610>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/14.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edba10>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/10.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50050>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/2.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed9510>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/13.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eae610>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/16.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e989d0>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/18.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c44550>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/20.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/2.jpg not downloaded yet
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/3.jpg not downloaded yet
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/4.jpg not downloaded yet
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/5.jpg not downloaded yet
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/6.jpg not downloaded yet
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/7.jpg not downloaded yet
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f388d0>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/3.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6bd0>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/10.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/8.jpg not downloaded yet
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/9.jpg not downloaded yet
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dea590>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/9.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4a950>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/2.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec7790>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/11.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de2e50>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/19.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48150>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/4.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1510>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/1.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/10.jpg not downloaded yet
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/11.jpg not downloaded yet
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/12.jpg not downloaded yet
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/13.jpg not downloaded yet
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/14.jpg not downloaded yet
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/15.jpg not downloaded yet
2026-01-28 20:02:13 [ayvens.be] INFO: Found listing with ID: 1878052
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878052%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.be] INFO: Scrape type for 1878052: 1
2026-01-28 20:02:13 [ayvens.be] INFO: Extracting data for car ID: 1878052
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be839c4-b87f-5b57-bd5e-5e2962713f76 with identifier: 1878052
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be839c4-b87f-5b57-bd5e-5e2962713f76 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b41690>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/1.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/2.jpg not downloaded yet
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c275d0>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/13.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efc410>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/14.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7450>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/18.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0e610>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/19.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0cd0>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/12.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4a450>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/20.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99d10>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/8.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/3.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/4.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/5.jpg not downloaded yet
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/6.jpg not downloaded yet
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/7.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/8.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/9.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/10.jpg not downloaded yet
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/11.jpg not downloaded yet
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d67e90>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/4.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3ee10>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/2.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e810>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/6.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/12.jpg not downloaded yet
2026-01-28 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f26050>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/3.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62550>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/7.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d71fd0>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/8.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6cad0>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/17.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb7f10>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/16.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/13.jpg not downloaded yet
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/14.jpg not downloaded yet
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5de50>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/11.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/15.jpg not downloaded yet
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/16.jpg not downloaded yet
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/17.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/18.jpg not downloaded yet
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/19.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/20.jpg not downloaded yet
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee29d0>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/5.jpg saved to cache
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:21 [ayvens.be] INFO: Found listing with ID: 1878053
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878053%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [ayvens.be] INFO: Scrape type for 1878053: 1
2026-01-28 20:02:21 [ayvens.be] INFO: Extracting data for car ID: 1878053
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ebff37-fa8d-5538-b913-772e17544ecf with identifier: 1878053
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ebff37-fa8d-5538-b913-772e17544ecf with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/1.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/2.jpg not downloaded yet
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e073d0>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/10.jpg saved to cache
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14d50>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/3.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d94450>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/15.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49e90>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/12.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0150>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/9.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48910>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/7.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c09650>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/4.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/3.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/4.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/5.jpg not downloaded yet
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/6.jpg not downloaded yet
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/7.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/8.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/9.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/10.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/11.jpg not downloaded yet
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3d550>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/11.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da6250>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/10.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f244d0>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/12.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccfc10>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/6.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b92d10>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/5.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/12.jpg not downloaded yet
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e1d0>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/9.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de2010>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/7.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2af10>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/8.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/13.jpg not downloaded yet
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/14.jpg not downloaded yet
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/15.jpg not downloaded yet
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/16.jpg not downloaded yet
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/17.jpg not downloaded yet
2026-01-28 20:02:26 [ayvens.be] INFO: Found listing with ID: 1878054
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878054%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.be] INFO: Scrape type for 1878054: 1
2026-01-28 20:02:26 [ayvens.be] INFO: Extracting data for car ID: 1878054
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97423463-b1bb-5f9c-a478-b072ebcc895f with identifier: 1878054
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97423463-b1bb-5f9c-a478-b072ebcc895f with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/1.jpg not downloaded yet
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99510>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/15.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/2.jpg not downloaded yet
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90c90>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/1.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63750>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/14.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6790>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/2.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8e04250>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/18.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a790>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/16.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cee290>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/13.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51dd0>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/15.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/3.jpg not downloaded yet
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/4.jpg not downloaded yet
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/5.jpg not downloaded yet
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/6.jpg not downloaded yet
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/7.jpg not downloaded yet
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/8.jpg not downloaded yet
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/9.jpg not downloaded yet
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/10.jpg not downloaded yet
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26fd0>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/20.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/11.jpg not downloaded yet
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e905d0>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/3.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2e850>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/2.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc9850>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/5.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52a50>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/4.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9a250>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/12.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8510>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/19.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/12.jpg not downloaded yet
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/13.jpg not downloaded yet
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99350>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/1.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/14.jpg not downloaded yet
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/15.jpg not downloaded yet
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/16.jpg not downloaded yet
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/17.jpg not downloaded yet
2026-01-28 20:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/18.jpg not downloaded yet
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deb990>
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/14.jpg saved to cache
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/19.jpg not downloaded yet
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e61790>
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/15.jpg saved to cache
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1cd0>
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/11.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2d250>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/2.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2f850>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/10.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:34 [ayvens.be] INFO: Found listing with ID: 1878055
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878055%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [ayvens.be] INFO: Scrape type for 1878055: 1
2026-01-28 20:02:34 [ayvens.be] INFO: Extracting data for car ID: 1878055
2026-01-28 20:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7802207-fdf3-5f4f-9a1d-6203990589fd with identifier: 1878055
2026-01-28 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7802207-fdf3-5f4f-9a1d-6203990589fd with scrape type 1
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/1.jpg not downloaded yet
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/2.jpg not downloaded yet
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32450>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/13.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50310>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/9.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfd650>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/8.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/3.jpg not downloaded yet
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/4.jpg not downloaded yet
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/5.jpg not downloaded yet
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/6.jpg not downloaded yet
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/7.jpg not downloaded yet
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/8.jpg not downloaded yet
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/9.jpg not downloaded yet
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65e90>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/5.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/10.jpg not downloaded yet
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d650d0>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/4.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee5090>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/10.jpg saved to cache
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51290>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/11.jpg saved to cache
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/11.jpg not downloaded yet
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cebf50>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/7.jpg saved to cache
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e310>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/6.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df52d0>
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/9.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e613d0>
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/8.jpg saved to cache
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/12.jpg not downloaded yet
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/13.jpg not downloaded yet
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/14.jpg not downloaded yet
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/15.jpg not downloaded yet
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [ayvens.be] INFO: Found listing with ID: 1878056
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878056%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [ayvens.be] INFO: Scrape type for 1878056: 1
2026-01-28 20:02:39 [ayvens.be] INFO: Extracting data for car ID: 1878056
2026-01-28 20:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d45eaa56-c8cf-5880-b732-c7eb4703b483 with identifier: 1878056
2026-01-28 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d45eaa56-c8cf-5880-b732-c7eb4703b483 with scrape type 1
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/1.jpg not downloaded yet
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/2.jpg not downloaded yet
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/3.jpg not downloaded yet
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da6cd0>
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/14.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f174d0>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/1.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da7f90>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/19.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/4.jpg not downloaded yet
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91390>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/13.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d960d0>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/3.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/5.jpg not downloaded yet
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b43bd0>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/15.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51a90>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/1.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d20d50>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/12.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/6.jpg not downloaded yet
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/7.jpg not downloaded yet
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de31d0>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/2.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/8.jpg not downloaded yet
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/9.jpg not downloaded yet
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de38d0>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/3.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/10.jpg not downloaded yet
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/11.jpg not downloaded yet
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/12.jpg not downloaded yet
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99490>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/4.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f627d0>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/11.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfc290>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/18.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63750>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/10.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98090>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/8.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9b8d0>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/9.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/13.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/14.jpg not downloaded yet
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eafc90>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/12.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/15.jpg not downloaded yet
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/16.jpg not downloaded yet
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/17.jpg not downloaded yet
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef5f90>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/7.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de3090>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/14.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e579d0>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/5.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/18.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/19.jpg not downloaded yet
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f356d0>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/6.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0deb0d0>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/13.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9990>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/17.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/20.jpg not downloaded yet
2026-01-28 20:02:47 [ayvens.be] INFO: Found listing with ID: 1878057
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878057%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [ayvens.be] INFO: Scrape type for 1878057: 1
2026-01-28 20:02:47 [ayvens.be] INFO: Extracting data for car ID: 1878057
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59111d33-74c8-52db-9132-0b455d7c7548 with identifier: 1878057
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59111d33-74c8-52db-9132-0b455d7c7548 with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/1.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/2.jpg not downloaded yet
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74190>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/4.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07c10>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/3.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/3.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/4.jpg not downloaded yet
2026-01-28 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff0910>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/5.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/5.jpg not downloaded yet
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/6.jpg not downloaded yet
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/7.jpg not downloaded yet
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6010>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/2.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e190>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/6.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5ad0>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/7.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91c50>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/1.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63cd0>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8e50700b94a44174b974f6c887e7ecff%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/15.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e7802207-fdf3-5f4f-9a1d-6203990589fd
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7802207-fdf3-5f4f-9a1d-6203990589fd, skipping ID generation
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7802207-fdf3-5f4f-9a1d-6203990589fd with scrape type 1
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e7802207-fdf3-5f4f-9a1d-6203990589fd from tracking dictionaries
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7802207-fdf3-5f4f-9a1d-6203990589fd sending to next pipeline
2026-01-28 20:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e7802207-fdf3-5f4f-9a1d-6203990589fd, identifier: 1878055
2026-01-28 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e7802207-fdf3-5f4f-9a1d-6203990589fd with identifier: 1878055
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e7802207-fdf3-5f4f-9a1d-6203990589fd with identifier: 1878055
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e7802207-fdf3-5f4f-9a1d-6203990589fd spider: ayvens.be
2026-01-28 20:02:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e7802207-fdf3-5f4f-9a1d-6203990589fd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e7802207-fdf3-5f4f-9a1d-6203990589fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 48271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388984,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7802207-fdf3-5f4f-9a1d-6203990589fd/e7802207-fdf3-5f4f-9a1d-6203990589fd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8e50700b94a44174b974f6c887e7ecff/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878055%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [ayvens.be] INFO: Saving data for 1878055: {'created_time': 1769630571.530794, 'last_price_update_time': 1769630571.530805, 'auction_closing_time': 1770202800.0}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878055') HTTP/1.1" 204 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/8.jpg not downloaded yet
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/9.jpg not downloaded yet
2026-01-28 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6f5d0>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/8.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0b90>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/9.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9350>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/12.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/10.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/11.jpg not downloaded yet
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edae50>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/11.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/12.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/13.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f146d0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/14.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f23e90>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/13.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/14.jpg not downloaded yet
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/15.jpg not downloaded yet
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f15cd0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/10.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da4390>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/17.jpg saved to cache
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbd690>
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/16.jpg saved to cache
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f360d0>
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/19.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34b10>
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/15.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/16.jpg not downloaded yet
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/17.jpg not downloaded yet
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/18.jpg not downloaded yet
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/19.jpg not downloaded yet
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/20.jpg not downloaded yet
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [ayvens.be] INFO: Found listing with ID: 1878058
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878058%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [ayvens.be] INFO: Scrape type for 1878058: 1
2026-01-28 20:02:55 [ayvens.be] INFO: Extracting data for car ID: 1878058
2026-01-28 20:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e9abf19-1dca-5314-9063-5589bdaec65b with identifier: 1878058
2026-01-28 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e9abf19-1dca-5314-9063-5589bdaec65b with scrape type 1
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/1.jpg not downloaded yet
2026-01-28 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50c90>
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/2.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/2.jpg not downloaded yet
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff1050>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/1.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3ed0>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/20.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30350>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8d8fe5ac410647389d36f6353243b5e4%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/18.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d45eaa56-c8cf-5880-b732-c7eb4703b483
2026-01-28 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d45eaa56-c8cf-5880-b732-c7eb4703b483, skipping ID generation
2026-01-28 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d45eaa56-c8cf-5880-b732-c7eb4703b483 with scrape type 1
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d45eaa56-c8cf-5880-b732-c7eb4703b483 from tracking dictionaries
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d45eaa56-c8cf-5880-b732-c7eb4703b483 sending to next pipeline
2026-01-28 20:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d45eaa56-c8cf-5880-b732-c7eb4703b483, identifier: 1878056
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f061d0>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/3.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3e9d0>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/4.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b68fd0>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/7.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/3.jpg not downloaded yet
2026-01-28 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d45eaa56-c8cf-5880-b732-c7eb4703b483 with identifier: 1878056
2026-01-28 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d45eaa56-c8cf-5880-b732-c7eb4703b483 with identifier: 1878056
2026-01-28 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d45eaa56-c8cf-5880-b732-c7eb4703b483 spider: ayvens.be
2026-01-28 20:02:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d45eaa56-c8cf-5880-b732-c7eb4703b483 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd45eaa56-c8cf-5880-b732-c7eb4703b483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 60430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d45eaa56-c8cf-5880-b732-c7eb4703b483/d45eaa56-c8cf-5880-b732-c7eb4703b483_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8d8fe5ac410647389d36f6353243b5e4/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878056%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [ayvens.be] INFO: Saving data for 1878056: {'created_time': 1769630578.635176, 'last_price_update_time': 1769630578.635188, 'auction_closing_time': 1770202800.0}
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878056') HTTP/1.1" 204 0
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31b50>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/6.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/4.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/5.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/6.jpg not downloaded yet
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/7.jpg not downloaded yet
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/8.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/9.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/10.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/11.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/12.jpg not downloaded yet
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf1c90>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/5.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e54bd0>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/11.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eb9490>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/10.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05250>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F838eb5e872ba41b4a075d596427a0269%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/16.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 97423463-b1bb-5f9c-a478-b072ebcc895f
2026-01-28 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97423463-b1bb-5f9c-a478-b072ebcc895f, skipping ID generation
2026-01-28 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97423463-b1bb-5f9c-a478-b072ebcc895f with scrape type 1
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97423463-b1bb-5f9c-a478-b072ebcc895f from tracking dictionaries
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97423463-b1bb-5f9c-a478-b072ebcc895f sending to next pipeline
2026-01-28 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 97423463-b1bb-5f9c-a478-b072ebcc895f, identifier: 1878054
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff1a50>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/9.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e59610>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/14.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/13.jpg not downloaded yet
2026-01-28 20:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 97423463-b1bb-5f9c-a478-b072ebcc895f with identifier: 1878054
2026-01-28 20:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 97423463-b1bb-5f9c-a478-b072ebcc895f with identifier: 1878054
2026-01-28 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 97423463-b1bb-5f9c-a478-b072ebcc895f spider: ayvens.be
2026-01-28 20:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 97423463-b1bb-5f9c-a478-b072ebcc895f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '97423463-b1bb-5f9c-a478-b072ebcc895f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 36288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 844918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97423463-b1bb-5f9c-a478-b072ebcc895f/97423463-b1bb-5f9c-a478-b072ebcc895f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/838eb5e872ba41b4a075d596427a0269/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 3.1T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 3.1T',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878054%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [ayvens.be] INFO: Saving data for 1878054: {'created_time': 1769630582.194412, 'last_price_update_time': 1769630582.194422, 'auction_closing_time': 1770202800.0}
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878054') HTTP/1.1" 204 0
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9b150>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/13.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd2ad0>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/8.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/14.jpg not downloaded yet
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/15.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/16.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/17.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/18.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/19.jpg not downloaded yet
2026-01-28 20:03:03 [ayvens.be] INFO: Found listing with ID: 1878059
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878059%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [ayvens.be] INFO: Scrape type for 1878059: 1
2026-01-28 20:03:03 [ayvens.be] INFO: Extracting data for car ID: 1878059
2026-01-28 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5092a162-3389-5d1f-92dd-b2f04a0a9142 with identifier: 1878059
2026-01-28 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5092a162-3389-5d1f-92dd-b2f04a0a9142 with scrape type 1
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/1.jpg not downloaded yet
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/2.jpg not downloaded yet
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96d10>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/15.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b41dd0>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/17.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2110>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/18.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1b10>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/16.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1b10>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/17.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/3.jpg not downloaded yet
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5cc10>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/12.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfe010>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/2.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebbe50>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/19.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/4.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/5.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/6.jpg not downloaded yet
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/7.jpg not downloaded yet
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/8.jpg not downloaded yet
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/9.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/10.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/11.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/12.jpg not downloaded yet
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e16590>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/16.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22b50>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/4.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/13.jpg not downloaded yet
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebaa10>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fff1c42be6abb4c5bac7241b2384f5240%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/20.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 59111d33-74c8-52db-9132-0b455d7c7548
2026-01-28 20:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59111d33-74c8-52db-9132-0b455d7c7548, skipping ID generation
2026-01-28 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59111d33-74c8-52db-9132-0b455d7c7548 with scrape type 1
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59111d33-74c8-52db-9132-0b455d7c7548 from tracking dictionaries
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59111d33-74c8-52db-9132-0b455d7c7548 sending to next pipeline
2026-01-28 20:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59111d33-74c8-52db-9132-0b455d7c7548, identifier: 1878057
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08d50>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/5.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f26010>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/1.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96090>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/13.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b13210>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/3.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1dd90>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/6.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:09 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/14.jpg not downloaded yet
2026-01-28 20:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59111d33-74c8-52db-9132-0b455d7c7548 with identifier: 1878057
2026-01-28 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59111d33-74c8-52db-9132-0b455d7c7548 with identifier: 1878057
2026-01-28 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 59111d33-74c8-52db-9132-0b455d7c7548 spider: ayvens.be
2026-01-28 20:03:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 59111d33-74c8-52db-9132-0b455d7c7548 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '59111d33-74c8-52db-9132-0b455d7c7548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 35412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 816489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59111d33-74c8-52db-9132-0b455d7c7548/59111d33-74c8-52db-9132-0b455d7c7548_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/ff1c42be6abb4c5bac7241b2384f5240/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878057%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [ayvens.be] INFO: Saving data for 1878057: {'created_time': 1769630590.079013, 'last_price_update_time': 1769630590.079026, 'auction_closing_time': 1770202800.0}
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878057') HTTP/1.1" 204 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/15.jpg not downloaded yet
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/16.jpg not downloaded yet
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/17.jpg not downloaded yet
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/18.jpg not downloaded yet
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/19.jpg not downloaded yet
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/20.jpg not downloaded yet
2026-01-28 20:03:10 [ayvens.be] INFO: Found listing with ID: 1878060
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878060%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [ayvens.be] INFO: Scrape type for 1878060: 1
2026-01-28 20:03:10 [ayvens.be] INFO: Extracting data for car ID: 1878060
2026-01-28 20:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9589490b-9ee4-53de-b925-c7d6177d224e with identifier: 1878060
2026-01-28 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9589490b-9ee4-53de-b925-c7d6177d224e with scrape type 1
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/1.jpg not downloaded yet
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/2.jpg not downloaded yet
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5550>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/15.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfe190>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/3.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eaf910>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/10.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b6a8d0>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/11.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dff310>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/16.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49b90>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/14.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/3.jpg not downloaded yet
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfb2d0>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/12.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f18f90>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/17.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/4.jpg not downloaded yet
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/5.jpg not downloaded yet
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/6.jpg not downloaded yet
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/7.jpg not downloaded yet
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/8.jpg not downloaded yet
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/9.jpg not downloaded yet
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/10.jpg not downloaded yet
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b290>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/5.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96d10>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/1.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccdfd0>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/19.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9aa50>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/4.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/11.jpg not downloaded yet
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0edd0>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/7.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8ee90>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/2.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b12a50>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/6.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27bd0>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/13.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/12.jpg not downloaded yet
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/13.jpg not downloaded yet
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/14.jpg not downloaded yet
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/15.jpg not downloaded yet
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/16.jpg not downloaded yet
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/17.jpg not downloaded yet
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/18.jpg not downloaded yet
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cae350>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/3.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5b990>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/15.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/19.jpg not downloaded yet
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/20.jpg not downloaded yet
2026-01-28 20:03:16 [ayvens.be] INFO: Found listing with ID: 1878061
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878061%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [ayvens.be] INFO: Scrape type for 1878061: 1
2026-01-28 20:03:16 [ayvens.be] INFO: Extracting data for car ID: 1878061
2026-01-28 20:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ed4124-42be-5643-b361-e2809fe04add with identifier: 1878061
2026-01-28 20:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ed4124-42be-5643-b361-e2809fe04add with scrape type 1
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/1.jpg not downloaded yet
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f04f50>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/1.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcce50>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/16.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05010>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/2.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0950>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/20.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de98d0>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/19.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de9f10>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/18.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/2.jpg not downloaded yet
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/3.jpg not downloaded yet
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/4.jpg not downloaded yet
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/5.jpg not downloaded yet
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/6.jpg not downloaded yet
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3450>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/5.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/7.jpg not downloaded yet
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/8.jpg not downloaded yet
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2390>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/4.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de29d0>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/17.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edca10>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/14.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65c90>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/6.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c029d0>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/11.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14510>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/11.jpg saved to cache
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84a90>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/12.jpg saved to cache
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/9.jpg not downloaded yet
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/10.jpg not downloaded yet
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/11.jpg not downloaded yet
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/12.jpg not downloaded yet
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/13.jpg not downloaded yet
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/14.jpg not downloaded yet
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/15.jpg not downloaded yet
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c781d0>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/12.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b110>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/13.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/16.jpg not downloaded yet
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3cd10>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/10.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58b90>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/14.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/17.jpg not downloaded yet
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6fd0>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/9.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd3a50>
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/19.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e62210>
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/18.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1fc10>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/8.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/18.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/19.jpg not downloaded yet
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/20.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [ayvens.be] INFO: Found listing with ID: 1878062
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878062%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [ayvens.be] INFO: Scrape type for 1878062: 1
2026-01-28 20:03:24 [ayvens.be] INFO: Extracting data for car ID: 1878062
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 with identifier: 1878062
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/1.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/2.jpg not downloaded yet
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52790>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/2.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b533d0>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/1.jpg saved to cache
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/3.jpg not downloaded yet
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/4.jpg not downloaded yet
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/5.jpg not downloaded yet
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6cad0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/17.jpg saved to cache
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e04ed0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/16.jpg saved to cache
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6310>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/3.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7e50>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/20.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60a50>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/15.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6b50>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/7.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/6.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/7.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/8.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/9.jpg not downloaded yet
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/10.jpg not downloaded yet
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/11.jpg not downloaded yet
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/12.jpg not downloaded yet
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c44450>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/9.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/13.jpg not downloaded yet
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78310>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/10.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6ffd0>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/11.jpg saved to cache
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c580d0>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/14.jpg saved to cache
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0debb50>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/8.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c2fe90>
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/16.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f14390>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/15.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/14.jpg not downloaded yet
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/15.jpg not downloaded yet
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78390>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/6.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [ayvens.be] INFO: Found listing with ID: 1878063
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878063%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [ayvens.be] INFO: Scrape type for 1878063: 1
2026-01-28 20:03:30 [ayvens.be] INFO: Extracting data for car ID: 1878063
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 with identifier: 1878063
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 with scrape type 1
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/1.jpg not downloaded yet
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/2.jpg not downloaded yet
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/3.jpg not downloaded yet
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/4.jpg not downloaded yet
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/5.jpg not downloaded yet
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8ee90>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/18.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/6.jpg not downloaded yet
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/7.jpg not downloaded yet
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/8.jpg not downloaded yet
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2a990>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/12.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d141d0>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/17.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b918d0>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/19.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3ee10>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/2.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3e050>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/3.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd1090>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/1.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c5bb50>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/13.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/9.jpg not downloaded yet
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/10.jpg not downloaded yet
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/11.jpg not downloaded yet
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/12.jpg not downloaded yet
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/13.jpg not downloaded yet
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/14.jpg not downloaded yet
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3c9d0>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/6.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d21e10>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/5.jpg saved to cache
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/15.jpg not downloaded yet
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33650>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/4.jpg saved to cache
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57910>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/7.jpg saved to cache
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcb310>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/4.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2f190>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/13.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2caced0>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Fb8ca8175452b49cb97f035d3038e8616%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/20.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 68ed4124-42be-5643-b361-e2809fe04add
2026-01-28 20:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68ed4124-42be-5643-b361-e2809fe04add, skipping ID generation
2026-01-28 20:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ed4124-42be-5643-b361-e2809fe04add with scrape type 1
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 68ed4124-42be-5643-b361-e2809fe04add from tracking dictionaries
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68ed4124-42be-5643-b361-e2809fe04add sending to next pipeline
2026-01-28 20:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68ed4124-42be-5643-b361-e2809fe04add, identifier: 1878061
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4250>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/5.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/16.jpg not downloaded yet
2026-01-28 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68ed4124-42be-5643-b361-e2809fe04add with identifier: 1878061
2026-01-28 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68ed4124-42be-5643-b361-e2809fe04add with identifier: 1878061
2026-01-28 20:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68ed4124-42be-5643-b361-e2809fe04add with identifier: 1878061 to the API
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '68ed4124-42be-5643-b361-e2809fe04add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 86951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 804425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68ed4124-42be-5643-b361-e2809fe04add/68ed4124-42be-5643-b361-e2809fe04add_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/b8ca8175452b49cb97f035d3038e8616/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878061%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [ayvens.be] INFO: Saving data for 1878061: {'created_time': 1769630616.607193, 'last_price_update_time': 1769630616.607203, 'auction_closing_time': 1770202800.0}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878061') HTTP/1.1" 204 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/17.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/18.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/19.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [ayvens.be] INFO: Found listing with ID: 1878064
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878064%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [ayvens.be] INFO: Scrape type for 1878064: 1
2026-01-28 20:03:36 [ayvens.be] INFO: Extracting data for car ID: 1878064
2026-01-28 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e with identifier: 1878064
2026-01-28 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e with scrape type 1
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/1.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/2.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/3.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/4.jpg not downloaded yet
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8590>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/15.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee77d0>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/14.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/5.jpg not downloaded yet
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e17ed0>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/1.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03f50>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/5.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64b50>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/3.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/6.jpg not downloaded yet
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd10d0>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/2.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6f010>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/6.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0790>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/4.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/7.jpg not downloaded yet
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/8.jpg not downloaded yet
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/9.jpg not downloaded yet
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/10.jpg not downloaded yet
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/11.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/12.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/13.jpg not downloaded yet
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77a90>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/12.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/14.jpg not downloaded yet
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d190>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/10.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f20e10>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/7.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8cd0>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/15.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eea810>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/11.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/15.jpg not downloaded yet
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/16.jpg not downloaded yet
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca5550>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/9.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de0550>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/10.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee22d0>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/8.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/17.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/18.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/19.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/20.jpg not downloaded yet
2026-01-28 20:03:42 [ayvens.be] INFO: Found listing with ID: 1878065
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878065%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [ayvens.be] INFO: Scrape type for 1878065: 1
2026-01-28 20:03:42 [ayvens.be] INFO: Extracting data for car ID: 1878065
2026-01-28 20:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6affd43a-b503-5e11-947d-e642f994e9c9 with identifier: 1878065
2026-01-28 20:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6affd43a-b503-5e11-947d-e642f994e9c9 with scrape type 1
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/1.jpg not downloaded yet
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/2.jpg not downloaded yet
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50950>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/19.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f25350>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/18.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f22750>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/13.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc3c10>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/4.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f25610>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/16.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/3.jpg not downloaded yet
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49850>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/17.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfde50>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/12.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7ed0>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/14.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/4.jpg not downloaded yet
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/5.jpg not downloaded yet
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/6.jpg not downloaded yet
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/7.jpg not downloaded yet
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/8.jpg not downloaded yet
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/9.jpg not downloaded yet
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/10.jpg not downloaded yet
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/11.jpg not downloaded yet
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48bd0>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/3.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/12.jpg not downloaded yet
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48650>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/6.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/13.jpg not downloaded yet
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/14.jpg not downloaded yet
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee3350>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/8.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c271d0>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/5.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc7650>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/2.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8cb50>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/7.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e890>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/9.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c096d0>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/15.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/15.jpg not downloaded yet
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/16.jpg not downloaded yet
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/17.jpg not downloaded yet
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/18.jpg not downloaded yet
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/19.jpg not downloaded yet
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62cd0>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/16.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/20.jpg not downloaded yet
2026-01-28 20:03:50 [ayvens.be] INFO: Found listing with ID: 1878066
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878066%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [ayvens.be] INFO: Scrape type for 1878066: 1
2026-01-28 20:03:50 [ayvens.be] INFO: Extracting data for car ID: 1878066
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0beaee04-0107-5431-9930-b50ab61004aa with identifier: 1878066
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0beaee04-0107-5431-9930-b50ab61004aa with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/1.jpg not downloaded yet
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/2.jpg not downloaded yet
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf0d90>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/17.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9150>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/18.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c64690>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/2.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2c50>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/3.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49d10>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/14.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0a10>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/13.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26390>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/12.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/3.jpg not downloaded yet
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/4.jpg not downloaded yet
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/5.jpg not downloaded yet
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/6.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/7.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/8.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/9.jpg not downloaded yet
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eac450>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/5.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/10.jpg not downloaded yet
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b450>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/4.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccce90>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/6.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d706d0>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/12.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29910>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/11.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64b50>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/1.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/11.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/12.jpg not downloaded yet
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7c9d0>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/13.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/13.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/14.jpg not downloaded yet
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/15.jpg not downloaded yet
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/16.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/17.jpg not downloaded yet
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cadb90>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/10.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6710>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/20.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/18.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/19.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/20.jpg not downloaded yet
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfb190>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/15.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f04b50>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/14.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3f410>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/7.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad9775cd0>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/9.jpg saved to cache
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73a50>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/16.jpg saved to cache
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c68b90>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/8.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [ayvens.be] INFO: Found listing with ID: 1878067
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878067%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [ayvens.be] INFO: Scrape type for 1878067: 1
2026-01-28 20:03:58 [ayvens.be] INFO: Extracting data for car ID: 1878067
2026-01-28 20:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41892fda-c859-513c-afb6-3f1c42a446b8 with identifier: 1878067
2026-01-28 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41892fda-c859-513c-afb6-3f1c42a446b8 with scrape type 1
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/1.jpg not downloaded yet
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/2.jpg not downloaded yet
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/3.jpg not downloaded yet
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d90a10>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/3.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f39f50>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/20.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/4.jpg not downloaded yet
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/5.jpg not downloaded yet
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/6.jpg not downloaded yet
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1310>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/4.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5ed10>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/19.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deae50>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/2.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5d0d0>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/18.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deafd0>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F8580ab6c7bc64860b5357437f0beefb7%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/17.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6affd43a-b503-5e11-947d-e642f994e9c9
2026-01-28 20:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6affd43a-b503-5e11-947d-e642f994e9c9, skipping ID generation
2026-01-28 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6affd43a-b503-5e11-947d-e642f994e9c9 with scrape type 1
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6affd43a-b503-5e11-947d-e642f994e9c9 from tracking dictionaries
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6affd43a-b503-5e11-947d-e642f994e9c9 sending to next pipeline
2026-01-28 20:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6affd43a-b503-5e11-947d-e642f994e9c9, identifier: 1878065
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53990>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/1.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6affd43a-b503-5e11-947d-e642f994e9c9 with identifier: 1878065
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6affd43a-b503-5e11-947d-e642f994e9c9 with identifier: 1878065
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6affd43a-b503-5e11-947d-e642f994e9c9 spider: ayvens.be
2026-01-28 20:04:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6affd43a-b503-5e11-947d-e642f994e9c9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6affd43a-b503-5e11-947d-e642f994e9c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 34068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 750605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692651,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6affd43a-b503-5e11-947d-e642f994e9c9/6affd43a-b503-5e11-947d-e642f994e9c9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/8580ab6c7bc64860b5357437f0beefb7/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878065%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [ayvens.be] INFO: Saving data for 1878065: {'created_time': 1769630641.849728, 'last_price_update_time': 1769630641.849738, 'auction_closing_time': 1770202800.0}
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878065') HTTP/1.1" 204 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/7.jpg not downloaded yet
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/8.jpg not downloaded yet
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6a10>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/11.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/9.jpg not downloaded yet
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/10.jpg not downloaded yet
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2c4d0>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/12.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/11.jpg not downloaded yet
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/12.jpg not downloaded yet
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea1d50>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/14.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbded0>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/13.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/13.jpg not downloaded yet
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/14.jpg not downloaded yet
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/15.jpg not downloaded yet
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44450>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/10.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91850>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/18.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/16.jpg not downloaded yet
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/17.jpg not downloaded yet
2026-01-28 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e47310>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/8.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2caefd0>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/9.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2caffd0>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/20.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/18.jpg not downloaded yet
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/19.jpg not downloaded yet
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/20.jpg not downloaded yet
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef5550>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/19.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb43d0>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/1.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [ayvens.be] INFO: Found listing with ID: 1878068
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878068%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [ayvens.be] INFO: Scrape type for 1878068: 1
2026-01-28 20:04:06 [ayvens.be] INFO: Extracting data for car ID: 1878068
2026-01-28 20:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edd237e6-d734-5660-b043-566da5f2b749 with identifier: 1878068
2026-01-28 20:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edd237e6-d734-5660-b043-566da5f2b749 with scrape type 1
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/1.jpg not downloaded yet
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/2.jpg not downloaded yet
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c015d0>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/4.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51d90>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/3.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/3.jpg not downloaded yet
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/4.jpg not downloaded yet
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/5.jpg not downloaded yet
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2250>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/16.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6010>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/2.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e994d0>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/6.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64c90>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/17.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 2 pages/min), scraped 1 items (at 1 items/min)
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/6.jpg not downloaded yet
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/7.jpg not downloaded yet
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d17890>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/7.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/8.jpg not downloaded yet
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/9.jpg not downloaded yet
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/10.jpg not downloaded yet
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52390>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/10.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30410>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/9.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de7cd0>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/8.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/11.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/12.jpg not downloaded yet
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb550>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/5.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25750>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/11.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3450>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/13.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5de90>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/12.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/13.jpg not downloaded yet
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/14.jpg not downloaded yet
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/15.jpg not downloaded yet
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0f790>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/15.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1e50>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/18.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/16.jpg not downloaded yet
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/17.jpg not downloaded yet
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcc750>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/16.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d710>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/17.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/18.jpg not downloaded yet
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66c50>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/15.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4350>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/19.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef4b50>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/14.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e750>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6e0d4201e874a3b9f598ddee293ceab%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/20.jpg saved to cache
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 41892fda-c859-513c-afb6-3f1c42a446b8
2026-01-28 20:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41892fda-c859-513c-afb6-3f1c42a446b8, skipping ID generation
2026-01-28 20:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41892fda-c859-513c-afb6-3f1c42a446b8 with scrape type 1
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 41892fda-c859-513c-afb6-3f1c42a446b8 from tracking dictionaries
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41892fda-c859-513c-afb6-3f1c42a446b8 sending to next pipeline
2026-01-28 20:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 41892fda-c859-513c-afb6-3f1c42a446b8, identifier: 1878067
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/19.jpg not downloaded yet
2026-01-28 20:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 41892fda-c859-513c-afb6-3f1c42a446b8 with identifier: 1878067
2026-01-28 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 41892fda-c859-513c-afb6-3f1c42a446b8 with identifier: 1878067
2026-01-28 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 41892fda-c859-513c-afb6-3f1c42a446b8 spider: ayvens.be
2026-01-28 20:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 41892fda-c859-513c-afb6-3f1c42a446b8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '41892fda-c859-513c-afb6-3f1c42a446b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 83994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622554,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41892fda-c859-513c-afb6-3f1c42a446b8/41892fda-c859-513c-afb6-3f1c42a446b8_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740865,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6e0d4201e874a3b9f598ddee293ceab/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878067%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [ayvens.be] INFO: Saving data for 1878067: {'created_time': 1769630654.818697, 'last_price_update_time': 1769630654.818707, 'auction_closing_time': 1770202800.0}
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878067') HTTP/1.1" 204 0
2026-01-28 20:04:14 [ayvens.be] INFO: Found listing with ID: 1878069
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878069%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [ayvens.be] INFO: Scrape type for 1878069: 1
2026-01-28 20:04:14 [ayvens.be] INFO: Extracting data for car ID: 1878069
2026-01-28 20:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7fc32a9-15ea-53ca-9262-5ba92153839e with identifier: 1878069
2026-01-28 20:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7fc32a9-15ea-53ca-9262-5ba92153839e with scrape type 1
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/1.jpg not downloaded yet
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25990>
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/2.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/2.jpg not downloaded yet
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/3.jpg not downloaded yet
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/4.jpg not downloaded yet
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/5.jpg not downloaded yet
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/6.jpg not downloaded yet
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/7.jpg not downloaded yet
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7e90>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/5.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27150>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/4.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/8.jpg not downloaded yet
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/9.jpg not downloaded yet
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/10.jpg not downloaded yet
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b770d0>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/7.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77410>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/6.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0fe50>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/1.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3d6d0>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/3.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deb150>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/10.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5b10>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/8.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/11.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/12.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/13.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/14.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/15.jpg not downloaded yet
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/16.jpg not downloaded yet
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcf1d0>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/11.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/17.jpg not downloaded yet
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d90ad0>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/12.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/18.jpg not downloaded yet
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/19.jpg not downloaded yet
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edeb50>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/15.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b890>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/13.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c350>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/14.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e55350>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/7.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07a50>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/18.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85e50>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/9.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [ayvens.be] INFO: Found listing with ID: 1878070
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878070%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [ayvens.be] INFO: Scrape type for 1878070: 1
2026-01-28 20:04:20 [ayvens.be] INFO: Extracting data for car ID: 1878070
2026-01-28 20:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with identifier: 1878070
2026-01-28 20:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with scrape type 1
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/1.jpg not downloaded yet
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/2.jpg not downloaded yet
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/3.jpg not downloaded yet
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/4.jpg not downloaded yet
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/5.jpg not downloaded yet
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f27990>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/19.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/6.jpg not downloaded yet
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/7.jpg not downloaded yet
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/8.jpg not downloaded yet
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0250>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/1.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1650>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/4.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4aa10>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/17.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec8c10>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/3.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4be10>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/2.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3550>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F607dcbe6d5574871b455e1233a81cdba%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/16.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item edd237e6-d734-5660-b043-566da5f2b749
2026-01-28 20:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: edd237e6-d734-5660-b043-566da5f2b749, skipping ID generation
2026-01-28 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edd237e6-d734-5660-b043-566da5f2b749 with scrape type 1
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item edd237e6-d734-5660-b043-566da5f2b749 from tracking dictionaries
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item edd237e6-d734-5660-b043-566da5f2b749 sending to next pipeline
2026-01-28 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: edd237e6-d734-5660-b043-566da5f2b749, identifier: 1878068
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07ad0>
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/8.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: edd237e6-d734-5660-b043-566da5f2b749 with identifier: 1878068
2026-01-28 20:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: edd237e6-d734-5660-b043-566da5f2b749 with identifier: 1878068
2026-01-28 20:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: edd237e6-d734-5660-b043-566da5f2b749 spider: ayvens.be
2026-01-28 20:04:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: edd237e6-d734-5660-b043-566da5f2b749 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'edd237e6-d734-5660-b043-566da5f2b749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 46941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 861895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737649,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edd237e6-d734-5660-b043-566da5f2b749/edd237e6-d734-5660-b043-566da5f2b749_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/607dcbe6d5574871b455e1233a81cdba/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878068%27 HTTP/1.1" 200 None
2026-01-28 20:04:23 [ayvens.be] INFO: Saving data for 1878068: {'created_time': 1769630663.750647, 'last_price_update_time': 1769630663.750658, 'auction_closing_time': 1770202800.0}
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878068') HTTP/1.1" 204 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/9.jpg not downloaded yet
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/10.jpg not downloaded yet
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/11.jpg not downloaded yet
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/12.jpg not downloaded yet
2026-01-28 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/13.jpg not downloaded yet
2026-01-28 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/14.jpg not downloaded yet
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/15.jpg not downloaded yet
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d580d0>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/10.jpg saved to cache
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8d210>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/13.jpg saved to cache
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:24 [ayvens.be] INFO: Found listing with ID: 1878071
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878071%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [ayvens.be] INFO: Scrape type for 1878071: 1
2026-01-28 20:04:24 [ayvens.be] INFO: Extracting data for car ID: 1878071
2026-01-28 20:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17061860-ec02-5b94-b333-15e25bd86f50 with identifier: 1878071
2026-01-28 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17061860-ec02-5b94-b333-15e25bd86f50 with scrape type 1
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/1.jpg not downloaded yet
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c66010>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/11.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfcbd0>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/7.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0590>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/12.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfd4d0>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/6.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e59f50>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/9.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5850>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/18.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/2.jpg not downloaded yet
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/3.jpg not downloaded yet
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/4.jpg not downloaded yet
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/5.jpg not downloaded yet
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/6.jpg not downloaded yet
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/7.jpg not downloaded yet
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c590>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/19.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/8.jpg not downloaded yet
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/9.jpg not downloaded yet
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/10.jpg not downloaded yet
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcc750>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/1.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8dd90>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/3.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79410>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/16.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b52ad0>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/8.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8fb90>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/2.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78a90>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/17.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7a4d0>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/15.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/11.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/12.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/13.jpg not downloaded yet
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/14.jpg not downloaded yet
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/15.jpg not downloaded yet
2026-01-28 20:04:29 [ayvens.be] INFO: Found listing with ID: 1878072
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878072%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [ayvens.be] INFO: Scrape type for 1878072: 1
2026-01-28 20:04:29 [ayvens.be] INFO: Extracting data for car ID: 1878072
2026-01-28 20:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55b8d31-5e9f-5bc0-8796-d615db1882f2 with identifier: 1878072
2026-01-28 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55b8d31-5e9f-5bc0-8796-d615db1882f2 with scrape type 1
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/1.jpg not downloaded yet
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/2.jpg not downloaded yet
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cae190>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/9.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f33fd0>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/1.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d550>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/15.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/3.jpg not downloaded yet
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6c10>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/10.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32350>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/14.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1b50>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/11.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60e10>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/6.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f983d0>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/7.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/4.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/5.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/6.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/7.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/8.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/9.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/10.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/11.jpg not downloaded yet
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/12.jpg not downloaded yet
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99d90>
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/5.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/13.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/14.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/15.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/16.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/17.jpg not downloaded yet
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/18.jpg not downloaded yet
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51290>
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/4.jpg saved to cache
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/19.jpg not downloaded yet
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48650>
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/11.jpg saved to cache
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/20.jpg not downloaded yet
2026-01-28 20:04:33 [ayvens.be] INFO: Found listing with ID: 1878073
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878073%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [ayvens.be] INFO: Scrape type for 1878073: 1
2026-01-28 20:04:33 [ayvens.be] INFO: Extracting data for car ID: 1878073
2026-01-28 20:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f838e01c-f079-5f9d-bb41-15477ecc1038 with identifier: 1878073
2026-01-28 20:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f838e01c-f079-5f9d-bb41-15477ecc1038 with scrape type 1
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/1.jpg not downloaded yet
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c09990>
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/13.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6510>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/2.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6610>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/3.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c02610>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/7.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f22650>
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/12.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b12d90>
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/8.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/2.jpg not downloaded yet
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/3.jpg not downloaded yet
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/4.jpg not downloaded yet
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/5.jpg not downloaded yet
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/6.jpg not downloaded yet
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/7.jpg not downloaded yet
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6de10>
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/9.jpg saved to cache
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/8.jpg not downloaded yet
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/9.jpg not downloaded yet
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05a10>
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/5.jpg saved to cache
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49510>
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252F14842a3f231d4be6a5d5decb342ed18a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/4.jpg saved to cache
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903
2026-01-28 20:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb2d3ec3-e34a-53fb-914e-3d4b2889d903, skipping ID generation
2026-01-28 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with scrape type 1
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fb2d3ec3-e34a-53fb-914e-3d4b2889d903 from tracking dictionaries
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb2d3ec3-e34a-53fb-914e-3d4b2889d903 sending to next pipeline
2026-01-28 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fb2d3ec3-e34a-53fb-914e-3d4b2889d903, identifier: 1878070
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b106d0>
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/10.jpg saved to cache
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79a90>
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/6.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebb6d0>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/12.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3f990>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/14.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfd650>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/5.jpg saved to cache
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with identifier: 1878070
2026-01-28 20:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with identifier: 1878070
2026-01-28 20:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fb2d3ec3-e34a-53fb-914e-3d4b2889d903 with identifier: 1878070 to the API
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fb2d3ec3-e34a-53fb-914e-3d4b2889d903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 80072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2d3ec3-e34a-53fb-914e-3d4b2889d903/fb2d3ec3-e34a-53fb-914e-3d4b2889d903_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/14842a3f231d4be6a5d5decb342ed18a/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878070%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [ayvens.be] INFO: Saving data for 1878070: {'created_time': 1769630679.402951, 'last_price_update_time': 1769630679.40296, 'auction_closing_time': 1770202800.0}
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878070') HTTP/1.1" 204 0
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/10.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/11.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/12.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/13.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/14.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/15.jpg not downloaded yet
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e59a50>
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/15.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceb0d0>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/14.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4bb50>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/13.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de9cd0>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/12.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5b590>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/11.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e51850>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/10.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52d90>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/17.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52890>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/16.jpg saved to cache
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/16.jpg not downloaded yet
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/17.jpg not downloaded yet
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/18.jpg not downloaded yet
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/19.jpg not downloaded yet
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/20.jpg not downloaded yet
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [ayvens.be] INFO: Found listing with ID: 1878074
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878074%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [ayvens.be] INFO: Scrape type for 1878074: 1
2026-01-28 20:04:42 [ayvens.be] INFO: Extracting data for car ID: 1878074
2026-01-28 20:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a40f760-7881-5ddb-9fc5-43890806bb41 with identifier: 1878074
2026-01-28 20:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a40f760-7881-5ddb-9fc5-43890806bb41 with scrape type 1
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/1.jpg not downloaded yet
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/2.jpg not downloaded yet
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/3.jpg not downloaded yet
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6690>
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/1.jpg saved to cache
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/4.jpg not downloaded yet
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1a110>
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/3.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dff990>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/2.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/5.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/6.jpg not downloaded yet
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f143d0>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/20.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad995e850>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/6.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9bf50>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/7.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2550>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/5.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25e90>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/8.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/7.jpg not downloaded yet
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/8.jpg not downloaded yet
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/9.jpg not downloaded yet
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/10.jpg not downloaded yet
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3e250>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/11.jpg saved to cache
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/11.jpg not downloaded yet
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/12.jpg not downloaded yet
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/13.jpg not downloaded yet
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f32a10>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/16.jpg saved to cache
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e563d0>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/15.jpg saved to cache
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef6550>
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/14.jpg saved to cache
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbced0>
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/13.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b12a90>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/10.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c499d0>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/9.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28610>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/12.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/14.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/15.jpg not downloaded yet
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/16.jpg not downloaded yet
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/17.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/18.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/19.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/20.jpg not downloaded yet
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a445d0>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/17.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3f650>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/18.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79410>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/2.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e24250>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/1.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e996d0>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/4.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cea890>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/3.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:50 [ayvens.be] INFO: Found listing with ID: 1878075
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878075%27 HTTP/1.1" 200 None
2026-01-28 20:04:50 [ayvens.be] INFO: Scrape type for 1878075: 1
2026-01-28 20:04:50 [ayvens.be] INFO: Extracting data for car ID: 1878075
2026-01-28 20:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ad67fe-0ca5-5739-bf67-1916e37e7802 with identifier: 1878075
2026-01-28 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ad67fe-0ca5-5739-bf67-1916e37e7802 with scrape type 1
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/1.jpg not downloaded yet
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edc990>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/19.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7b10>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/20.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/2.jpg not downloaded yet
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/3.jpg not downloaded yet
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/4.jpg not downloaded yet
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/5.jpg not downloaded yet
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/6.jpg not downloaded yet
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/7.jpg not downloaded yet
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/8.jpg not downloaded yet
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6ca10>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/10.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/9.jpg not downloaded yet
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e17590>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/9.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9b890>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/6.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/10.jpg not downloaded yet
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a47c50>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/7.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3f1d0>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/8.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8d790>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/11.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3510>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F7c0f61bfb2dd43e185cce435f3e970d8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/4.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f838e01c-f079-5f9d-bb41-15477ecc1038
2026-01-28 20:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f838e01c-f079-5f9d-bb41-15477ecc1038, skipping ID generation
2026-01-28 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f838e01c-f079-5f9d-bb41-15477ecc1038 with scrape type 1
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f838e01c-f079-5f9d-bb41-15477ecc1038 from tracking dictionaries
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f838e01c-f079-5f9d-bb41-15477ecc1038 sending to next pipeline
2026-01-28 20:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f838e01c-f079-5f9d-bb41-15477ecc1038, identifier: 1878073
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edb210>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/5.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/11.jpg not downloaded yet
2026-01-28 20:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f838e01c-f079-5f9d-bb41-15477ecc1038 with identifier: 1878073
2026-01-28 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f838e01c-f079-5f9d-bb41-15477ecc1038 with identifier: 1878073
2026-01-28 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f838e01c-f079-5f9d-bb41-15477ecc1038 spider: ayvens.be
2026-01-28 20:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f838e01c-f079-5f9d-bb41-15477ecc1038 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f838e01c-f079-5f9d-bb41-15477ecc1038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 36858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608341,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733832,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f838e01c-f079-5f9d-bb41-15477ecc1038/f838e01c-f079-5f9d-bb41-15477ecc1038_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/7c0f61bfb2dd43e185cce435f3e970d8/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878073%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [ayvens.be] INFO: Saving data for 1878073: {'created_time': 1769630695.134221, 'last_price_update_time': 1769630695.134232, 'auction_closing_time': 1770202800.0}
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878073') HTTP/1.1" 204 0
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/12.jpg not downloaded yet
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/13.jpg not downloaded yet
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/14.jpg not downloaded yet
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/15.jpg not downloaded yet
2026-01-28 20:04:55 [ayvens.be] INFO: Found listing with ID: 1878076
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878076%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [ayvens.be] INFO: Scrape type for 1878076: 1
2026-01-28 20:04:55 [ayvens.be] INFO: Extracting data for car ID: 1878076
2026-01-28 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d61d3506-40cc-5369-97a1-fa022d103e26 with identifier: 1878076
2026-01-28 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61d3506-40cc-5369-97a1-fa022d103e26 with scrape type 1
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/1.jpg not downloaded yet
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/2.jpg not downloaded yet
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1610>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/14.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efcc90>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/18.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4cb10>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/13.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37a10>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/12.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/3.jpg not downloaded yet
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/4.jpg not downloaded yet
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd37d0>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/1.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3ed90>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/15.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da74d0>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/19.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3c610>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/9.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/5.jpg not downloaded yet
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/6.jpg not downloaded yet
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/7.jpg not downloaded yet
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/8.jpg not downloaded yet
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/9.jpg not downloaded yet
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/10.jpg not downloaded yet
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5e590>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/20.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/11.jpg not downloaded yet
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5ec50>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/2.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98990>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/4.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/12.jpg not downloaded yet
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/13.jpg not downloaded yet
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de2f50>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/17.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efc4d0>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/10.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4ac90>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/18.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e258d0>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/3.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8df10>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/19.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/14.jpg not downloaded yet
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/15.jpg not downloaded yet
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90910>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/11.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/16.jpg not downloaded yet
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/17.jpg not downloaded yet
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/18.jpg not downloaded yet
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07f90>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/12.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfab50>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/9.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9150>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/8.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df8fd0>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/13.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/19.jpg not downloaded yet
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/20.jpg not downloaded yet
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50e50>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/7.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfd750>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/6.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c66010>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/3.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [ayvens.be] INFO: Found listing with ID: 1878077
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878077%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [ayvens.be] INFO: Scrape type for 1878077: 1
2026-01-28 20:05:04 [ayvens.be] INFO: Extracting data for car ID: 1878077
2026-01-28 20:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d9adad-279c-5c82-aed3-5a534b40f2ba with identifier: 1878077
2026-01-28 20:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d9adad-279c-5c82-aed3-5a534b40f2ba with scrape type 1
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/1.jpg not downloaded yet
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/2.jpg not downloaded yet
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/3.jpg not downloaded yet
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/4.jpg not downloaded yet
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/5.jpg not downloaded yet
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb7450>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/2.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36110>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/5.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f25e10>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/4.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/6.jpg not downloaded yet
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/7.jpg not downloaded yet
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/8.jpg not downloaded yet
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8290>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/15.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c798d0>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/1.jpg saved to cache
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6890>
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/6.jpg saved to cache
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee1690>
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/7.jpg saved to cache
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7a90>
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/8.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/9.jpg not downloaded yet
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/10.jpg not downloaded yet
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/11.jpg not downloaded yet
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/12.jpg not downloaded yet
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/13.jpg not downloaded yet
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/14.jpg not downloaded yet
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/15.jpg not downloaded yet
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/16.jpg not downloaded yet
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ed90>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/11.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e47590>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/15.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3da90>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/14.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c00490>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/14.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5e3d0>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/12.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/17.jpg not downloaded yet
2026-01-28 20:05:09 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 1 pages/min), scraped 2 items (at 1 items/min)
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b41650>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/10.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/18.jpg not downloaded yet
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/19.jpg not downloaded yet
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc7950>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/13.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebaa50>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/9.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/20.jpg not downloaded yet
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [ayvens.be] INFO: Found listing with ID: 1878078
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878078%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [ayvens.be] INFO: Scrape type for 1878078: 1
2026-01-28 20:05:10 [ayvens.be] INFO: Extracting data for car ID: 1878078
2026-01-28 20:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67edb426-e1e6-571f-b1fc-fabac95d4a93 with identifier: 1878078
2026-01-28 20:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67edb426-e1e6-571f-b1fc-fabac95d4a93 with scrape type 1
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/1.jpg not downloaded yet
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/2.jpg not downloaded yet
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/3.jpg not downloaded yet
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/4.jpg not downloaded yet
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/5.jpg not downloaded yet
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba410>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/20.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba350>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/6.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/6.jpg not downloaded yet
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66ad0>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/5.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de1ad0>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/2.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deea10>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/4.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4d90>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/3.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/7.jpg not downloaded yet
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcf010>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/18.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6750>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/19.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/8.jpg not downloaded yet
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/9.jpg not downloaded yet
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/10.jpg not downloaded yet
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/11.jpg not downloaded yet
2026-01-28 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/12.jpg not downloaded yet
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/13.jpg not downloaded yet
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/14.jpg not downloaded yet
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/15.jpg not downloaded yet
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dea7d0>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/9.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:13 [ayvens.be] INFO: Found listing with ID: 1878079
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878079%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [ayvens.be] INFO: Scrape type for 1878079: 1
2026-01-28 20:05:13 [ayvens.be] INFO: Extracting data for car ID: 1878079
2026-01-28 20:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6597a662-58cf-58e6-b138-7b5118492ea7 with identifier: 1878079
2026-01-28 20:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6597a662-58cf-58e6-b138-7b5118492ea7 with scrape type 1
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/1.jpg not downloaded yet
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7c510>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/10.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/2.jpg not downloaded yet
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/3.jpg not downloaded yet
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4be50>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/17.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6c910>
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/1.jpg saved to cache
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9bd50>
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/7.jpg saved to cache
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f52e50>
2026-01-28 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/15.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f15810>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/16.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc74d0>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/8.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/4.jpg not downloaded yet
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/5.jpg not downloaded yet
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/6.jpg not downloaded yet
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/7.jpg not downloaded yet
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/8.jpg not downloaded yet
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/9.jpg not downloaded yet
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/10.jpg not downloaded yet
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/11.jpg not downloaded yet
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34690>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/18.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/12.jpg not downloaded yet
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c529d0>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/13.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc7e50>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/5.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2c10>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/19.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5cb10>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/14.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05250>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/6.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/13.jpg not downloaded yet
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4ec10>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/12.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff2390>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/20.jpg saved to cache
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/14.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/15.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/16.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/17.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/18.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/19.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/20.jpg not downloaded yet
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e55050>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/8.jpg saved to cache
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:20 [ayvens.be] INFO: Found listing with ID: 1878080
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878080%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [ayvens.be] INFO: Scrape type for 1878080: 1
2026-01-28 20:05:20 [ayvens.be] INFO: Extracting data for car ID: 1878080
2026-01-28 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1878080
2026-01-28 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with scrape type 1
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/1.jpg not downloaded yet
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a450>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/4.jpg saved to cache
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3b90>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/2.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c26f90>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/7.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26650>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/9.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c26210>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/10.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/2.jpg not downloaded yet
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/3.jpg not downloaded yet
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9f90>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/1.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc3f90>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/3.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/4.jpg not downloaded yet
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/5.jpg not downloaded yet
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/6.jpg not downloaded yet
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/7.jpg not downloaded yet
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/8.jpg not downloaded yet
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35410>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/4.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ef50>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/2.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6c150>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/15.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ec90>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/14.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/9.jpg not downloaded yet
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/10.jpg not downloaded yet
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deec50>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/3.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30650>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/5.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e92950>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/12.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6b50>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/11.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/11.jpg not downloaded yet
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/12.jpg not downloaded yet
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/13.jpg not downloaded yet
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/14.jpg not downloaded yet
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/15.jpg not downloaded yet
2026-01-28 20:05:25 [ayvens.be] INFO: Found listing with ID: 1878081
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878081%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [ayvens.be] INFO: Scrape type for 1878081: 1
2026-01-28 20:05:25 [ayvens.be] INFO: Extracting data for car ID: 1878081
2026-01-28 20:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6225a764-16e6-5b06-9611-5098b0dcd1ff with identifier: 1878081
2026-01-28 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225a764-16e6-5b06-9611-5098b0dcd1ff with scrape type 1
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/1.jpg not downloaded yet
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/2.jpg not downloaded yet
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23510>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/15.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f04690>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/10.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c690>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/9.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d610>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/16.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05b10>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/14.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8ce50>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/13.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8cb10>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/1.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/3.jpg not downloaded yet
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbfe90>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/8.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/4.jpg not downloaded yet
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/5.jpg not downloaded yet
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/6.jpg not downloaded yet
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/7.jpg not downloaded yet
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/8.jpg not downloaded yet
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/9.jpg not downloaded yet
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/10.jpg not downloaded yet
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/11.jpg not downloaded yet
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2e790>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/20.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/12.jpg not downloaded yet
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e210>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/4.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97650>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/3.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22910>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/19.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fca050>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/2.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/13.jpg not downloaded yet
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/14.jpg not downloaded yet
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfa8d0>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/18.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ed10>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/8.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfbc10>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/9.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/15.jpg not downloaded yet
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/16.jpg not downloaded yet
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/17.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/18.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/19.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/20.jpg not downloaded yet
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5890>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/11.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:32 [ayvens.be] INFO: Found listing with ID: 1878082
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878082%27 HTTP/1.1" 200 None
2026-01-28 20:05:32 [ayvens.be] INFO: Scrape type for 1878082: 1
2026-01-28 20:05:32 [ayvens.be] INFO: Extracting data for car ID: 1878082
2026-01-28 20:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bdd1215-bf2e-59e3-a490-fc7004c3a140 with identifier: 1878082
2026-01-28 20:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140 with scrape type 1
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg not downloaded yet
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef4450>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/10.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f18290>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/3.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eb9b50>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/5.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc8d90>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/6.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de99d0>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/12.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg not downloaded yet
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7690>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/7.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d550>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/13.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg not downloaded yet
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg not downloaded yet
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg not downloaded yet
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg not downloaded yet
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg not downloaded yet
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg not downloaded yet
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg not downloaded yet
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25e50>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/15.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c458d0>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F41fb0893cfa34485903afbce24885e38%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/14.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2
2026-01-28 20:05:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2, skipping ID generation
2026-01-28 20:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with scrape type 1
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 from tracking dictionaries
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 sending to next pipeline
2026-01-28 20:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2, identifier: 1878080
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg not downloaded yet
2026-01-28 20:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1878080
2026-01-28 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 with identifier: 1878080
2026-01-28 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 spider: ayvens.be
2026-01-28 20:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 86101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624165,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2/f64134c3-a7d2-50a0-a5d3-8da2bdfd65f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/41fb0893cfa34485903afbce24885e38/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878080%27 HTTP/1.1" 200 None
2026-01-28 20:05:36 [ayvens.be] INFO: Saving data for 1878080: {'created_time': 1769630736.857015, 'last_price_update_time': 1769630736.857024, 'auction_closing_time': 1770202800.0}
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878080') HTTP/1.1" 204 0
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27650>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/1.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc8e10>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/5.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30910>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/12.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e36f50>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/2.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9a450>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/4.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e09d0>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/6.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg not downloaded yet
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg not downloaded yet
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg not downloaded yet
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg not downloaded yet
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg not downloaded yet
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg not downloaded yet
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg not downloaded yet
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg not downloaded yet
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de9790>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/10.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4450>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/11.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg not downloaded yet
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7a7d0>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/7.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49650>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/15.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg not downloaded yet
2026-01-28 20:05:40 [ayvens.be] INFO: Found listing with ID: 1878083
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878083%27 HTTP/1.1" 200 None
2026-01-28 20:05:40 [ayvens.be] INFO: Scrape type for 1878083: 1
2026-01-28 20:05:40 [ayvens.be] INFO: Extracting data for car ID: 1878083
2026-01-28 20:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6e304e-06a0-5e26-ba8d-07d676935737 with identifier: 1878083
2026-01-28 20:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6e304e-06a0-5e26-ba8d-07d676935737 with scrape type 1
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg not downloaded yet
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8f090>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/13.jpg saved to cache
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e3d0>
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/14.jpg saved to cache
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8c090>
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/9.jpg saved to cache
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27350>
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/8.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg not downloaded yet
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg not downloaded yet
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg not downloaded yet
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg not downloaded yet
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg not downloaded yet
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg not downloaded yet
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg not downloaded yet
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg not downloaded yet
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99150>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25c10>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/20.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg not downloaded yet
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50d10>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3c590>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3cf50>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd3c90>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg not downloaded yet
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg not downloaded yet
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25c10>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9f90>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/19.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg not downloaded yet
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg not downloaded yet
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg not downloaded yet
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg not downloaded yet
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg not downloaded yet
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2ee50>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg not downloaded yet
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg not downloaded yet
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99550>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d590d0>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0db50>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b119d0>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0b8d0>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4bb10>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3d50>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg not downloaded yet
2026-01-28 20:05:47 [ayvens.be] INFO: Found listing with ID: 1879005
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879005%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [ayvens.be] INFO: Scrape type for 1879005: 1
2026-01-28 20:05:47 [ayvens.be] INFO: Extracting data for car ID: 1879005
2026-01-28 20:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with identifier: 1879005
2026-01-28 20:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with scrape type 1
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/1.jpg not downloaded yet
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/2.jpg not downloaded yet
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/3.jpg not downloaded yet
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/4.jpg not downloaded yet
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/5.jpg not downloaded yet
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/6.jpg not downloaded yet
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/7.jpg not downloaded yet
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53a90>
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/8.jpg not downloaded yet
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a61750>
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg saved to cache
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e34d90>
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg saved to cache
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6f490>
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg saved to cache
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42010>
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg saved to cache
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e55b50>
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/9.jpg not downloaded yet
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/10.jpg not downloaded yet
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30835d0>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65cd0>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/11.jpg not downloaded yet
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/12.jpg not downloaded yet
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/13.jpg not downloaded yet
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [ayvens.be] INFO: Found listing with ID: 1879006
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879006%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [ayvens.be] INFO: Scrape type for 1879006: 1
2026-01-28 20:05:50 [ayvens.be] INFO: Extracting data for car ID: 1879006
2026-01-28 20:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with identifier: 1879006
2026-01-28 20:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with scrape type 1
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/1.jpg not downloaded yet
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/2.jpg not downloaded yet
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/3.jpg not downloaded yet
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/4.jpg not downloaded yet
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d849d0>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/5.jpg not downloaded yet
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5c1d0>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dea390>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce8e50>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/6.jpg not downloaded yet
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23350>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b450>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4ea10>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2f390>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/7.jpg not downloaded yet
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/8.jpg not downloaded yet
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5190>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/1.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/9.jpg not downloaded yet
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/10.jpg not downloaded yet
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0310>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/8.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e636d0>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7050>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/2.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/11.jpg not downloaded yet
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/12.jpg not downloaded yet
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/13.jpg not downloaded yet
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40190>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9250>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg saved to cache
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6250>
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg saved to cache
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3750>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d16c50>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/11.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/14.jpg not downloaded yet
2026-01-28 20:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:56 [ayvens.be] INFO: Found listing with ID: 1879007
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879007%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [ayvens.be] INFO: Scrape type for 1879007: 1
2026-01-28 20:05:56 [ayvens.be] INFO: Extracting data for car ID: 1879007
2026-01-28 20:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3f85f34-f5da-533c-90f2-ae68d0a14227 with identifier: 1879007
2026-01-28 20:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f85f34-f5da-533c-90f2-ae68d0a14227 with scrape type 1
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/1.jpg not downloaded yet
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8ec10>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/12.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082110>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/9.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e04d0>
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/10.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/2.jpg not downloaded yet
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/3.jpg not downloaded yet
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/4.jpg not downloaded yet
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e15110>
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/7.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96b90>
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/6.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33090>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/13.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1f750>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/6.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/5.jpg not downloaded yet
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/6.jpg not downloaded yet
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2e10>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/5.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c09050>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/4.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e175d0>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/3.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3750>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/1.jpg saved to cache
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/7.jpg not downloaded yet
2026-01-28 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/8.jpg not downloaded yet
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/9.jpg not downloaded yet
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c98fd0>
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/7.jpg saved to cache
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e6d0>
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/2.jpg saved to cache
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1ce10>
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/8.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dee350>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/10.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/10.jpg not downloaded yet
2026-01-28 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0d50>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/5.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd12d0>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/9.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080690>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/11.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/11.jpg not downloaded yet
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/12.jpg not downloaded yet
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea05d0>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/12.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de1a10>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/3.jpg saved to cache
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea1910>
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/13.jpg saved to cache
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de98d0>
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252Ffee612190279476bb553df52580f11f3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/4.jpg saved to cache
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17
2026-01-28 20:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 697a6e80-c0ad-53d5-bcaf-622f8879ba17, skipping ID generation
2026-01-28 20:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with scrape type 1
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 697a6e80-c0ad-53d5-bcaf-622f8879ba17 from tracking dictionaries
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 697a6e80-c0ad-53d5-bcaf-622f8879ba17 sending to next pipeline
2026-01-28 20:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 697a6e80-c0ad-53d5-bcaf-622f8879ba17, identifier: 1879005
2026-01-28 20:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with identifier: 1879005
2026-01-28 20:06:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with identifier: 1879005
2026-01-28 20:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 697a6e80-c0ad-53d5-bcaf-622f8879ba17 with identifier: 1879005 to the API
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '697a6e80-c0ad-53d5-bcaf-622f8879ba17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 41253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697a6e80-c0ad-53d5-bcaf-622f8879ba17/697a6e80-c0ad-53d5-bcaf-622f8879ba17_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/fee612190279476bb553df52580f11f3/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 30 TFSI 81KW ATTRACTION',
 'vin': None,
 'year': 2024}
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879005%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [ayvens.be] INFO: Saving data for 1879005: {'created_time': 1769630764.602823, 'last_price_update_time': 1769630764.602833, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879005') HTTP/1.1" 204 0
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/13.jpg not downloaded yet
2026-01-28 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:04 [ayvens.be] INFO: Found listing with ID: 1879008
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879008%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [ayvens.be] INFO: Scrape type for 1879008: 1
2026-01-28 20:06:04 [ayvens.be] INFO: Extracting data for car ID: 1879008
2026-01-28 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with identifier: 1879008
2026-01-28 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with scrape type 1
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/1.jpg not downloaded yet
2026-01-28 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6f90>
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252F782e776c46794efead885824bcc5af8b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/14.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879
2026-01-28 20:06:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 294d4bc3-c6ed-5425-a0d9-d1514d78f879, skipping ID generation
2026-01-28 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with scrape type 1
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 294d4bc3-c6ed-5425-a0d9-d1514d78f879 from tracking dictionaries
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 294d4bc3-c6ed-5425-a0d9-d1514d78f879 sending to next pipeline
2026-01-28 20:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 294d4bc3-c6ed-5425-a0d9-d1514d78f879, identifier: 1879006
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edbd50>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/1.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4add0>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/3.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/2.jpg not downloaded yet
2026-01-28 20:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with identifier: 1879006
2026-01-28 20:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with identifier: 1879006
2026-01-28 20:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 294d4bc3-c6ed-5425-a0d9-d1514d78f879 with identifier: 1879006 to the API
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '294d4bc3-c6ed-5425-a0d9-d1514d78f879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 116412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285007,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424715,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294d4bc3-c6ed-5425-a0d9-d1514d78f879/294d4bc3-c6ed-5425-a0d9-d1514d78f879_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/782e776c46794efead885824bcc5af8b/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO GT PACK',
 'vin': None,
 'year': 2022}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879006%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [ayvens.be] INFO: Saving data for 1879006: {'created_time': 1769630766.254541, 'last_price_update_time': 1769630766.254555, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879006') HTTP/1.1" 204 0
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/3.jpg not downloaded yet
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8a10>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg saved to cache
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2590>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/2.jpg saved to cache
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb110>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/4.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee0950>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/6.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/4.jpg not downloaded yet
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/5.jpg not downloaded yet
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbadb6f0550>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/5.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/6.jpg not downloaded yet
2026-01-28 20:06:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 3 pages/min), scraped 4 items (at 2 items/min)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/7.jpg not downloaded yet
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/8.jpg not downloaded yet
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30832d0>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/7.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46c10>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F372efa4b8b1243fbbc14d0811da5099a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc6e304e-06a0-5e26-ba8d-07d676935737
2026-01-28 20:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc6e304e-06a0-5e26-ba8d-07d676935737, skipping ID generation
2026-01-28 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6e304e-06a0-5e26-ba8d-07d676935737 with scrape type 1
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bc6e304e-06a0-5e26-ba8d-07d676935737 from tracking dictionaries
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc6e304e-06a0-5e26-ba8d-07d676935737 sending to next pipeline
2026-01-28 20:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc6e304e-06a0-5e26-ba8d-07d676935737, identifier: 1878083
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d090>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/8.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2290>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/9.jpg saved to cache
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e202d0>
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg saved to cache
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc6e304e-06a0-5e26-ba8d-07d676935737 with identifier: 1878083
2026-01-28 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc6e304e-06a0-5e26-ba8d-07d676935737 with identifier: 1878083
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'wit', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': False, 'make': 'maxus', 'model': 'edeliver 3', 'trim': 'bev 35kwh auto swb', 'title': 'maxus edeliver 3 bev 35kwh auto swb', 'price': 0, 'odometer': 11950, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-31', 'year': 2021, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160', 'expiration_date': '2026-02-04t11:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'bc6e304e-06a0-5e26-ba8d-07d676935737', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 662953}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 506788}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 602812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 558980}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 755143}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 686786}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 899460}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 741733}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 581147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 573148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 748218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 575029}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 672796}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 734907}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 631821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 631972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 533152}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 542837}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 668844}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'maxus edeliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 11950}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'wit',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-04t11:00:00z',
     'fuel_type': 'electric',
     'id': 'bc6e304e-06a0-5e26-ba8d-07d676935737',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
     'listing': 'auction',
     'location': None,
     'make': 'maxus',
     'make_model': 'maxus edeliver 3',
     'model': 'edeliver 3',
     'odometer': 11950,
     'odometer_in_km': 11950,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644261,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 662953,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 506788,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 602812,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 558980,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 755143,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 686786,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 899460,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 741733,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 581147,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 573148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 748218,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 575029,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 672796,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 734907,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 631821,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 631972,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 533152,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 542837,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 668844,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-31',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus edeliver 3 bev 35kwh auto swb',
     'transmission': 'automatic',
     'trim': 'bev 35kwh auto swb',
     'vin': None,
     'year': 2021}
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: bc6e304e-06a0-5e26-ba8d-07d676935737 spider: ayvens.be
2026-01-28 20:06:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: bc6e304e-06a0-5e26-ba8d-07d676935737 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'wit', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': False, 'make': 'maxus', 'model': 'edeliver 3', 'trim': 'bev 35kwh auto swb', 'title': 'maxus edeliver 3 bev 35kwh auto swb', 'price': 0, 'odometer': 11950, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-31', 'year': 2021, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160', 'expiration_date': '2026-02-04t11:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'bc6e304e-06a0-5e26-ba8d-07d676935737', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644261}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 662953}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 506788}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 602812}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 558980}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 755143}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 686786}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 899460}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 741733}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 581147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 573148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 748218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 575029}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 672796}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 734907}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 631821}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 631972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 533152}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 542837}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 668844}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'maxus edeliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 11950}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'wit',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-04t11:00:00z',
     'fuel_type': 'electric',
     'id': 'bc6e304e-06a0-5e26-ba8d-07d676935737',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
     'listing': 'auction',
     'location': None,
     'make': 'maxus',
     'make_model': 'maxus edeliver 3',
     'model': 'edeliver 3',
     'odometer': 11950,
     'odometer_in_km': 11950,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644261,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 662953,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 506788,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 602812,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 558980,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 755143,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 686786,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 899460,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 741733,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 581147,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 573148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 748218,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 575029,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 672796,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 734907,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 631821,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 631972,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 533152,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 542837,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 668844,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-31',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus edeliver 3 bev 35kwh auto swb',
     'transmission': 'automatic',
     'trim': 'bev 35kwh auto swb',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'electric',
 'id': 'bc6e304e-06a0-5e26-ba8d-07d676935737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'MAXUS',
 'model': 'EDELIVER 3',
 'odometer': 11950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558980,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 899460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631821,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533152,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc6e304e-06a0-5e26-ba8d-07d676935737/bc6e304e-06a0-5e26-ba8d-07d676935737_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/372efa4b8b1243fbbc14d0811da5099a/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MAXUS EDELIVER 3 BEV 35KWH AUTO SWB',
 'transmission': 'automatic',
 'trim': 'BEV 35KWH AUTO SWB',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878083%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [ayvens.be] INFO: Saving data for 1878083: {'created_time': 1769630769.662683, 'last_price_update_time': 1769630769.662691, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878083') HTTP/1.1" 204 0
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/9.jpg not downloaded yet
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/10.jpg not downloaded yet
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd2990>
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8d0d0>
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F0de1264b746447db913ab4402dcec182%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140
2026-01-28 20:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bdd1215-bf2e-59e3-a490-fc7004c3a140, skipping ID generation
2026-01-28 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140 with scrape type 1
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8bdd1215-bf2e-59e3-a490-fc7004c3a140 from tracking dictionaries
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bdd1215-bf2e-59e3-a490-fc7004c3a140 sending to next pipeline
2026-01-28 20:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8bdd1215-bf2e-59e3-a490-fc7004c3a140, identifier: 1878082
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8990>
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/10.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/11.jpg not downloaded yet
2026-01-28 20:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8bdd1215-bf2e-59e3-a490-fc7004c3a140 with identifier: 1878082
2026-01-28 20:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8bdd1215-bf2e-59e3-a490-fc7004c3a140 with identifier: 1878082
2026-01-28 20:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 22, 'seller_name': None, 'price_includes_vat': False, 'make': 'maxus', 'model': 'edeliver 3', 'trim': 'bev 35kwh auto swb', 'title': 'maxus edeliver 3 bev 35kwh auto swb', 'price': 0, 'odometer': 11821, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-31', 'year': 2021, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160', 'expiration_date': '2026-02-04t11:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '8bdd1215-bf2e-59e3-a490-fc7004c3a140', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 636637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 665206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 596017}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 619510}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 590426}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 720735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 710172}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 800771}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 770542}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 574321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 551582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 710134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 679746}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 712259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 742072}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 712578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 559940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 550147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 630044}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 548607}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'maxus edeliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 11821}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '',
     'expiration_date': '2026-02-04t11:00:00z',
     'fuel_type': 'electric',
     'id': '8bdd1215-bf2e-59e3-a490-fc7004c3a140',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
     'listing': 'auction',
     'location': None,
     'make': 'maxus',
     'make_model': 'maxus edeliver 3',
     'model': 'edeliver 3',
     'odometer': 11821,
     'odometer_in_km': 11821,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 22,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 636637,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 665206,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 596017,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 619510,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 590426,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 720735,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 710172,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 800771,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 770542,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 574321,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 551582,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 710134,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 679746,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 712259,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 742072,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 712578,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 559940,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 550147,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 630044,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 548607,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-31',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus edeliver 3 bev 35kwh auto swb',
     'transmission': 'automatic',
     'trim': 'bev 35kwh auto swb',
     'vin': None,
     'year': 2021}
2026-01-28 20:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 8bdd1215-bf2e-59e3-a490-fc7004c3a140 spider: ayvens.be
2026-01-28 20:06:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8bdd1215-bf2e-59e3-a490-fc7004c3a140 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 22, 'seller_name': None, 'price_includes_vat': False, 'make': 'maxus', 'model': 'edeliver 3', 'trim': 'bev 35kwh auto swb', 'title': 'maxus edeliver 3 bev 35kwh auto swb', 'price': 0, 'odometer': 11821, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-31', 'year': 2021, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160', 'expiration_date': '2026-02-04t11:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '8bdd1215-bf2e-59e3-a490-fc7004c3a140', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 636637}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 665206}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 596017}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 619510}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 590426}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 720735}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 710172}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 800771}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 770542}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 574321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 551582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 710134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 679746}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 712259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 742072}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 712578}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 559940}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 550147}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 630044}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 548607}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'maxus edeliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 11821}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '',
     'expiration_date': '2026-02-04t11:00:00z',
     'fuel_type': 'electric',
     'id': '8bdd1215-bf2e-59e3-a490-fc7004c3a140',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
     'listing': 'auction',
     'location': None,
     'make': 'maxus',
     'make_model': 'maxus edeliver 3',
     'model': 'edeliver 3',
     'odometer': 11821,
     'odometer_in_km': 11821,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 22,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 636637,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 665206,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 596017,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 619510,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 590426,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 720735,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 710172,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 800771,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 770542,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 574321,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 551582,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 710134,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 679746,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 712259,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 742072,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 712578,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 559940,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 550147,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 630044,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 548607,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-31',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus edeliver 3 bev 35kwh auto swb',
     'transmission': 'automatic',
     'trim': 'bev 35kwh auto swb',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'electric',
 'id': '8bdd1215-bf2e-59e3-a490-fc7004c3a140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'MAXUS',
 'model': 'EDELIVER 3',
 'odometer': 11821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665206,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550147,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bdd1215-bf2e-59e3-a490-fc7004c3a140/8bdd1215-bf2e-59e3-a490-fc7004c3a140_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/0de1264b746447db913ab4402dcec182/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MAXUS EDELIVER 3 BEV 35KWH AUTO SWB',
 'transmission': 'automatic',
 'trim': 'BEV 35KWH AUTO SWB',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878082%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [ayvens.be] INFO: Saving data for 1878082: {'created_time': 1769630771.26777, 'last_price_update_time': 1769630771.267784, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878082') HTTP/1.1" 204 0
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/12.jpg not downloaded yet
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65390>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/12.jpg saved to cache
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2510>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/11.jpg saved to cache
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/13.jpg not downloaded yet
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1f190>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252F00207550abb848dab0135f75eae86d40%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/13.jpg saved to cache
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e3f85f34-f5da-533c-90f2-ae68d0a14227
2026-01-28 20:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3f85f34-f5da-533c-90f2-ae68d0a14227, skipping ID generation
2026-01-28 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3f85f34-f5da-533c-90f2-ae68d0a14227 with scrape type 1
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e3f85f34-f5da-533c-90f2-ae68d0a14227 from tracking dictionaries
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3f85f34-f5da-533c-90f2-ae68d0a14227 sending to next pipeline
2026-01-28 20:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e3f85f34-f5da-533c-90f2-ae68d0a14227, identifier: 1879007
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e3f85f34-f5da-533c-90f2-ae68d0a14227 with identifier: 1879007
2026-01-28 20:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e3f85f34-f5da-533c-90f2-ae68d0a14227 with identifier: 1879007
2026-01-28 20:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e3f85f34-f5da-533c-90f2-ae68d0a14227 with identifier: 1879007 to the API
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e3f85f34-f5da-533c-90f2-ae68d0a14227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE A DIESEL (W177)',
 'odometer': 90753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243211,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276362,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3f85f34-f5da-533c-90f2-ae68d0a14227/e3f85f34-f5da-533c-90f2-ae68d0a14227_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/00207550abb848dab0135f75eae86d40/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE A DIESEL (W177) A 200 d Business Solution',
 'transmission': 'automatic',
 'trim': 'A 200 d Business Solution',
 'vin': None,
 'year': 2020}
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879007%27 HTTP/1.1" 200 None
2026-01-28 20:06:12 [ayvens.be] INFO: Saving data for 1879007: {'created_time': 1769630772.755241, 'last_price_update_time': 1769630772.755254, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879007') HTTP/1.1" 204 0
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/14.jpg not downloaded yet
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0bd0>
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/17.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:06:13 [ayvens.be] INFO: Found listing with ID: 1879009
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879009%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [ayvens.be] INFO: Scrape type for 1879009: 1
2026-01-28 20:06:13 [ayvens.be] INFO: Extracting data for car ID: 1879009
2026-01-28 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a339f036-a7a8-5884-93d1-a0ac2d9f7595 with identifier: 1879009
2026-01-28 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a339f036-a7a8-5884-93d1-a0ac2d9f7595 with scrape type 1
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/1.jpg not downloaded yet
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0dd0>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/18.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa310>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/3.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df78d0>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/1.jpg saved to cache
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/2.jpg not downloaded yet
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de3790>
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xw%252F111fde8f5d2f454dac62c95b04ba7271%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/16.jpg saved to cache
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6225a764-16e6-5b06-9611-5098b0dcd1ff
2026-01-28 20:06:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6225a764-16e6-5b06-9611-5098b0dcd1ff, skipping ID generation
2026-01-28 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225a764-16e6-5b06-9611-5098b0dcd1ff with scrape type 1
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6225a764-16e6-5b06-9611-5098b0dcd1ff from tracking dictionaries
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6225a764-16e6-5b06-9611-5098b0dcd1ff sending to next pipeline
2026-01-28 20:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6225a764-16e6-5b06-9611-5098b0dcd1ff, identifier: 1878081
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6f2d0>
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/2.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6225a764-16e6-5b06-9611-5098b0dcd1ff with identifier: 1878081
2026-01-28 20:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6225a764-16e6-5b06-9611-5098b0dcd1ff with identifier: 1878081
2026-01-28 20:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
2026-01-28 20:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6225a764-16e6-5b06-9611-5098b0dcd1ff spider: ayvens.be
2026-01-28 20:06:15 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6225a764-16e6-5b06-9611-5098b0dcd1ff due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6225a764-16e6-5b06-9611-5098b0dcd1ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 51514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 846843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6225a764-16e6-5b06-9611-5098b0dcd1ff/6225a764-16e6-5b06-9611-5098b0dcd1ff_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xw/111fde8f5d2f454dac62c95b04ba7271/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878081%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [ayvens.be] INFO: Saving data for 1878081: {'created_time': 1769630775.256094, 'last_price_update_time': 1769630775.256103, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878081') HTTP/1.1" 204 0
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/3.jpg not downloaded yet
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/4.jpg not downloaded yet
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0debcd0>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/17.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/5.jpg not downloaded yet
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/6.jpg not downloaded yet
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7f050>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/5.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc13d0>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/8.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8b10>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/6.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3c450>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/7.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58190>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/4.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/7.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/8.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0890>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fc5e14941630342ab9fc6d2bf43d50318%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/6.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6597a662-58cf-58e6-b138-7b5118492ea7
2026-01-28 20:06:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6597a662-58cf-58e6-b138-7b5118492ea7, skipping ID generation
2026-01-28 20:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6597a662-58cf-58e6-b138-7b5118492ea7 with scrape type 1
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6597a662-58cf-58e6-b138-7b5118492ea7 from tracking dictionaries
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6597a662-58cf-58e6-b138-7b5118492ea7 sending to next pipeline
2026-01-28 20:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6597a662-58cf-58e6-b138-7b5118492ea7, identifier: 1878079
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbd2d0>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/7.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/9.jpg not downloaded yet
2026-01-28 20:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6597a662-58cf-58e6-b138-7b5118492ea7 with identifier: 1878079
2026-01-28 20:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6597a662-58cf-58e6-b138-7b5118492ea7 with identifier: 1878079
2026-01-28 20:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6597a662-58cf-58e6-b138-7b5118492ea7 spider: ayvens.be
2026-01-28 20:06:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6597a662-58cf-58e6-b138-7b5118492ea7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '6597a662-58cf-58e6-b138-7b5118492ea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 102403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629270,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851570,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6597a662-58cf-58e6-b138-7b5118492ea7/6597a662-58cf-58e6-b138-7b5118492ea7_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/c5e14941630342ab9fc6d2bf43d50318/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878079%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [ayvens.be] INFO: Saving data for 1878079: {'created_time': 1769630778.064694, 'last_price_update_time': 1769630778.064705, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878079') HTTP/1.1" 204 0
2026-01-28 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/10.jpg not downloaded yet
2026-01-28 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/11.jpg not downloaded yet
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6350>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/10.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7bd0>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/12.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc13d0>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/11.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6e90>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/9.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/12.jpg not downloaded yet
2026-01-28 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/13.jpg not downloaded yet
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee0f10>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/13.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccf490>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/13.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6ccd0>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/12.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2050>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/11.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/14.jpg not downloaded yet
2026-01-28 20:06:20 [ayvens.be] INFO: Found listing with ID: 1879010
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879010%27 HTTP/1.1" 200 None
2026-01-28 20:06:21 [ayvens.be] INFO: Scrape type for 1879010: 1
2026-01-28 20:06:21 [ayvens.be] INFO: Extracting data for car ID: 1879010
2026-01-28 20:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with identifier: 1879010
2026-01-28 20:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with scrape type 1
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/1.jpg not downloaded yet
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e45c10>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/1.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8a10>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/2.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e990>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0ca5c373069c4e12ae036f6d677e3b03%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/14.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b
2026-01-28 20:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b, skipping ID generation
2026-01-28 20:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with scrape type 1
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b from tracking dictionaries
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8cd7fac-12fa-5586-aa27-e82b0d6cd14b sending to next pipeline
2026-01-28 20:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b, identifier: 1879008
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with identifier: 1879008
2026-01-28 20:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with identifier: 1879008
2026-01-28 20:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8cd7fac-12fa-5586-aa27-e82b0d6cd14b with identifier: 1879008 to the API
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'f8cd7fac-12fa-5586-aa27-e82b0d6cd14b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAMIQ',
 'odometer': 108694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372228,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341235,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 446448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8cd7fac-12fa-5586-aa27-e82b0d6cd14b/f8cd7fac-12fa-5586-aa27-e82b0d6cd14b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0ca5c373069c4e12ae036f6d677e3b03/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAMIQ 1.0 TSI 81KW DSG CLEVER',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG CLEVER',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879008%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [ayvens.be] INFO: Saving data for 1879008: {'created_time': 1769630782.574258, 'last_price_update_time': 1769630782.574272, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879008') HTTP/1.1" 204 0
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/2.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/3.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eebf90>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F4110ea0cce15450ab09cf856f12eb622%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/1.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67edb426-e1e6-571f-b1fc-fabac95d4a93
2026-01-28 20:06:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67edb426-e1e6-571f-b1fc-fabac95d4a93, skipping ID generation
2026-01-28 20:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67edb426-e1e6-571f-b1fc-fabac95d4a93 with scrape type 1
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67edb426-e1e6-571f-b1fc-fabac95d4a93 from tracking dictionaries
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67edb426-e1e6-571f-b1fc-fabac95d4a93 sending to next pipeline
2026-01-28 20:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 67edb426-e1e6-571f-b1fc-fabac95d4a93, identifier: 1878078
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e23510>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/3.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77e50>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/6.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/4.jpg not downloaded yet
2026-01-28 20:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 67edb426-e1e6-571f-b1fc-fabac95d4a93 with identifier: 1878078
2026-01-28 20:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 67edb426-e1e6-571f-b1fc-fabac95d4a93 with identifier: 1878078
2026-01-28 20:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 67edb426-e1e6-571f-b1fc-fabac95d4a93 spider: ayvens.be
2026-01-28 20:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 67edb426-e1e6-571f-b1fc-fabac95d4a93 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '67edb426-e1e6-571f-b1fc-fabac95d4a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 117949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67edb426-e1e6-571f-b1fc-fabac95d4a93/67edb426-e1e6-571f-b1fc-fabac95d4a93_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/4110ea0cce15450ab09cf856f12eb622/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878078%27 HTTP/1.1" 200 None
2026-01-28 20:06:23 [ayvens.be] INFO: Saving data for 1878078: {'created_time': 1769630783.833951, 'last_price_update_time': 1769630783.833964, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878078') HTTP/1.1" 204 0
2026-01-28 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/5.jpg not downloaded yet
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27f50>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F0936faf9acf1483b92bfb9f27458fe0c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/11.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c7d9adad-279c-5c82-aed3-5a534b40f2ba
2026-01-28 20:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7d9adad-279c-5c82-aed3-5a534b40f2ba, skipping ID generation
2026-01-28 20:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d9adad-279c-5c82-aed3-5a534b40f2ba with scrape type 1
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7d9adad-279c-5c82-aed3-5a534b40f2ba from tracking dictionaries
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7d9adad-279c-5c82-aed3-5a534b40f2ba sending to next pipeline
2026-01-28 20:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7d9adad-279c-5c82-aed3-5a534b40f2ba, identifier: 1878077
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb9d10>
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/5.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26c10>
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/7.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34e10>
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/4.jpg saved to cache
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7d9adad-279c-5c82-aed3-5a534b40f2ba with identifier: 1878077
2026-01-28 20:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7d9adad-279c-5c82-aed3-5a534b40f2ba with identifier: 1878077
2026-01-28 20:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c7d9adad-279c-5c82-aed3-5a534b40f2ba spider: ayvens.be
2026-01-28 20:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c7d9adad-279c-5c82-aed3-5a534b40f2ba due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7d9adad-279c-5c82-aed3-5a534b40f2ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 68362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 865163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 755027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582441,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7d9adad-279c-5c82-aed3-5a534b40f2ba/c7d9adad-279c-5c82-aed3-5a534b40f2ba_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/0936faf9acf1483b92bfb9f27458fe0c/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878077%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [ayvens.be] INFO: Saving data for 1878077: {'created_time': 1769630785.43298, 'last_price_update_time': 1769630785.432992, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878077') HTTP/1.1" 204 0
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/6.jpg not downloaded yet
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/7.jpg not downloaded yet
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee98d0>
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/17.jpg saved to cache
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8dd0>
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/10.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6cd50>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/9.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/8.jpg not downloaded yet
2026-01-28 20:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/9.jpg not downloaded yet
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de7f50>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/11.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2e10>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/8.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27850>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F467699929aea4003b3c2065e158d95e0%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/16.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d61d3506-40cc-5369-97a1-fa022d103e26
2026-01-28 20:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d61d3506-40cc-5369-97a1-fa022d103e26, skipping ID generation
2026-01-28 20:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d61d3506-40cc-5369-97a1-fa022d103e26 with scrape type 1
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d61d3506-40cc-5369-97a1-fa022d103e26 from tracking dictionaries
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d61d3506-40cc-5369-97a1-fa022d103e26 sending to next pipeline
2026-01-28 20:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d61d3506-40cc-5369-97a1-fa022d103e26, identifier: 1878076
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d61d3506-40cc-5369-97a1-fa022d103e26 with identifier: 1878076
2026-01-28 20:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d61d3506-40cc-5369-97a1-fa022d103e26 with identifier: 1878076
2026-01-28 20:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d61d3506-40cc-5369-97a1-fa022d103e26 spider: ayvens.be
2026-01-28 20:06:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d61d3506-40cc-5369-97a1-fa022d103e26 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd61d3506-40cc-5369-97a1-fa022d103e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 63920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 774902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 787404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d61d3506-40cc-5369-97a1-fa022d103e26/d61d3506-40cc-5369-97a1-fa022d103e26_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/467699929aea4003b3c2065e158d95e0/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878076%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [ayvens.be] INFO: Saving data for 1878076: {'created_time': 1769630787.682129, 'last_price_update_time': 1769630787.682141, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878076') HTTP/1.1" 204 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/10.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/11.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22950>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F873bea2ff8e04a498136e36c71b9be80%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/5.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07ad67fe-0ca5-5739-bf67-1916e37e7802
2026-01-28 20:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07ad67fe-0ca5-5739-bf67-1916e37e7802, skipping ID generation
2026-01-28 20:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ad67fe-0ca5-5739-bf67-1916e37e7802 with scrape type 1
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07ad67fe-0ca5-5739-bf67-1916e37e7802 from tracking dictionaries
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07ad67fe-0ca5-5739-bf67-1916e37e7802 sending to next pipeline
2026-01-28 20:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 07ad67fe-0ca5-5739-bf67-1916e37e7802, identifier: 1878075
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6f490>
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F3aeb0e3608d04c9db87241246fc25e80%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/16.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7a40f760-7881-5ddb-9fc5-43890806bb41
2026-01-28 20:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a40f760-7881-5ddb-9fc5-43890806bb41, skipping ID generation
2026-01-28 20:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a40f760-7881-5ddb-9fc5-43890806bb41 with scrape type 1
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7a40f760-7881-5ddb-9fc5-43890806bb41 from tracking dictionaries
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a40f760-7881-5ddb-9fc5-43890806bb41 sending to next pipeline
2026-01-28 20:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a40f760-7881-5ddb-9fc5-43890806bb41, identifier: 1878074
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/12.jpg not downloaded yet
2026-01-28 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 07ad67fe-0ca5-5739-bf67-1916e37e7802 with identifier: 1878075
2026-01-28 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 07ad67fe-0ca5-5739-bf67-1916e37e7802 with identifier: 1878075
2026-01-28 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 07ad67fe-0ca5-5739-bf67-1916e37e7802 spider: ayvens.be
2026-01-28 20:06:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 07ad67fe-0ca5-5739-bf67-1916e37e7802 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '07ad67fe-0ca5-5739-bf67-1916e37e7802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 61782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ad67fe-0ca5-5739-bf67-1916e37e7802/07ad67fe-0ca5-5739-bf67-1916e37e7802_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/873bea2ff8e04a498136e36c71b9be80/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878075%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [ayvens.be] INFO: Saving data for 1878075: {'created_time': 1769630788.803479, 'last_price_update_time': 1769630788.803488, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878075') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a40f760-7881-5ddb-9fc5-43890806bb41 with identifier: 1878074
2026-01-28 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a40f760-7881-5ddb-9fc5-43890806bb41 with identifier: 1878074
2026-01-28 20:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a40f760-7881-5ddb-9fc5-43890806bb41 with identifier: 1878074 to the API
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '7a40f760-7881-5ddb-9fc5-43890806bb41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 43832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491981,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a40f760-7881-5ddb-9fc5-43890806bb41/7a40f760-7881-5ddb-9fc5-43890806bb41_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/3aeb0e3608d04c9db87241246fc25e80/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878074%27 HTTP/1.1" 200 None
2026-01-28 20:06:29 [ayvens.be] INFO: Saving data for 1878074: {'created_time': 1769630789.199337, 'last_price_update_time': 1769630789.199348, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878074') HTTP/1.1" 204 0
2026-01-28 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/13.jpg not downloaded yet
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d15990>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/14.jpg saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c00690>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/12.jpg saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1f890>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ds%252F3aad49ac5c5b42889c894282e46b70bb%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/13.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a339f036-a7a8-5884-93d1-a0ac2d9f7595
2026-01-28 20:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a339f036-a7a8-5884-93d1-a0ac2d9f7595, skipping ID generation
2026-01-28 20:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a339f036-a7a8-5884-93d1-a0ac2d9f7595 with scrape type 1
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a339f036-a7a8-5884-93d1-a0ac2d9f7595 from tracking dictionaries
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a339f036-a7a8-5884-93d1-a0ac2d9f7595 sending to next pipeline
2026-01-28 20:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a339f036-a7a8-5884-93d1-a0ac2d9f7595, identifier: 1879009
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8590>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/1.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a339f036-a7a8-5884-93d1-a0ac2d9f7595 with identifier: 1879009
2026-01-28 20:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a339f036-a7a8-5884-93d1-a0ac2d9f7595 with identifier: 1879009
2026-01-28 20:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a339f036-a7a8-5884-93d1-a0ac2d9f7595 with identifier: 1879009 to the API
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a339f036-a7a8-5884-93d1-a0ac2d9f7595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 80704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311242,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a339f036-a7a8-5884-93d1-a0ac2d9f7595/a339f036-a7a8-5884-93d1-a0ac2d9f7595_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ds/3aad49ac5c5b42889c894282e46b70bb/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E PHEV (180KW) 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E PHEV (180KW) 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879009%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [ayvens.be] INFO: Saving data for 1879009: {'created_time': 1769630791.310922, 'last_price_update_time': 1769630791.310931, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879009') HTTP/1.1" 204 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/14.jpg not downloaded yet
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [ayvens.be] INFO: Found listing with ID: 1879011
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879011%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [ayvens.be] INFO: Scrape type for 1879011: 1
2026-01-28 20:06:31 [ayvens.be] INFO: Extracting data for car ID: 1879011
2026-01-28 20:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c with identifier: 1879011
2026-01-28 20:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c with scrape type 1
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/1.jpg not downloaded yet
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4f290>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/8.jpg saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/2.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/3.jpg not downloaded yet
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0ce90>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/7.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64ed0>
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/5.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e210>
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/4.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea1150>
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/2.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5d4d0>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/3.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/4.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/5.jpg not downloaded yet
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e16d50>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/6.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/6.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/7.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/8.jpg not downloaded yet
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78f10>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/4.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1390>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/8.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca68d0>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/6.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9b890>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/3.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3083b50>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/10.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/9.jpg not downloaded yet
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/10.jpg not downloaded yet
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d50e10>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/7.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d590>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/9.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8fd0>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/12.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6cb10>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/13.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/11.jpg not downloaded yet
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36790>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/2.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/12.jpg not downloaded yet
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/13.jpg not downloaded yet
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c310>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252F1678cd5e6217418592f0666695182c77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/1.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f55b8d31-5e9f-5bc0-8796-d615db1882f2
2026-01-28 20:06:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f55b8d31-5e9f-5bc0-8796-d615db1882f2, skipping ID generation
2026-01-28 20:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55b8d31-5e9f-5bc0-8796-d615db1882f2 with scrape type 1
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f55b8d31-5e9f-5bc0-8796-d615db1882f2 from tracking dictionaries
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f55b8d31-5e9f-5bc0-8796-d615db1882f2 sending to next pipeline
2026-01-28 20:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f55b8d31-5e9f-5bc0-8796-d615db1882f2, identifier: 1878072
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f55b8d31-5e9f-5bc0-8796-d615db1882f2 with identifier: 1878072
2026-01-28 20:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f55b8d31-5e9f-5bc0-8796-d615db1882f2 with identifier: 1878072
2026-01-28 20:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f55b8d31-5e9f-5bc0-8796-d615db1882f2 spider: ayvens.be
2026-01-28 20:06:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f55b8d31-5e9f-5bc0-8796-d615db1882f2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f55b8d31-5e9f-5bc0-8796-d615db1882f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 65532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600089,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903890,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640418,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 809070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55b8d31-5e9f-5bc0-8796-d615db1882f2/f55b8d31-5e9f-5bc0-8796-d615db1882f2_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/1678cd5e6217418592f0666695182c77/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878072%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [ayvens.be] INFO: Saving data for 1878072: {'created_time': 1769630798.076524, 'last_price_update_time': 1769630798.076534, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878072') HTTP/1.1" 204 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/14.jpg not downloaded yet
2026-01-28 20:06:38 [ayvens.be] INFO: Found listing with ID: 1879012
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879012%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [ayvens.be] INFO: Scrape type for 1879012: 1
2026-01-28 20:06:38 [ayvens.be] INFO: Extracting data for car ID: 1879012
2026-01-28 20:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944e4048-a5ba-5b7e-8226-857dc53ebf8f with identifier: 1879012
2026-01-28 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f with scrape type 1
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/1.jpg not downloaded yet
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f22cd0>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/14.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eb9750>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fq%252F3f82c1ce0a324125a9a876e846647626%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/11.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053
2026-01-28 20:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8cf7ef0-b75c-5d0c-b752-572cda3a1053, skipping ID generation
2026-01-28 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with scrape type 1
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a8cf7ef0-b75c-5d0c-b752-572cda3a1053 from tracking dictionaries
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8cf7ef0-b75c-5d0c-b752-572cda3a1053 sending to next pipeline
2026-01-28 20:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8cf7ef0-b75c-5d0c-b752-572cda3a1053, identifier: 1879010
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4b90>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/15.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eb8490>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/14.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1ced0>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/2.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e92790>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/1.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f39f50>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/3.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/2.jpg not downloaded yet
2026-01-28 20:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with identifier: 1879010
2026-01-28 20:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with identifier: 1879010
2026-01-28 20:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a8cf7ef0-b75c-5d0c-b752-572cda3a1053 with identifier: 1879010 to the API
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': 'a8cf7ef0-b75c-5d0c-b752-572cda3a1053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'EX30',
 'odometer': 54092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8cf7ef0-b75c-5d0c-b752-572cda3a1053/a8cf7ef0-b75c-5d0c-b752-572cda3a1053_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fq/3f82c1ce0a324125a9a876e846647626/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO EX30 BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH SINGLE MOTOR EXT. RANGE CORE',
 'vin': None,
 'year': 2024}
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879010%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [ayvens.be] INFO: Saving data for 1879010: {'created_time': 1769630802.743485, 'last_price_update_time': 1769630802.743496, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879010') HTTP/1.1" 204 0
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/3.jpg not downloaded yet
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/4.jpg not downloaded yet
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaba10>
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/6.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/5.jpg not downloaded yet
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/6.jpg not downloaded yet
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ee90>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/5.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee81d0>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/4.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6e510>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/7.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d976d0>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/8.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/7.jpg not downloaded yet
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/8.jpg not downloaded yet
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/9.jpg not downloaded yet
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15e50>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F35b2e23b9afb435a8c4064506fc17646%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/13.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 17061860-ec02-5b94-b333-15e25bd86f50
2026-01-28 20:06:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17061860-ec02-5b94-b333-15e25bd86f50, skipping ID generation
2026-01-28 20:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17061860-ec02-5b94-b333-15e25bd86f50 with scrape type 1
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 17061860-ec02-5b94-b333-15e25bd86f50 from tracking dictionaries
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17061860-ec02-5b94-b333-15e25bd86f50 sending to next pipeline
2026-01-28 20:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17061860-ec02-5b94-b333-15e25bd86f50, identifier: 1878071
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0a450>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdaaa511a55224e5f9fef5bbdd1e3b52b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/5.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7fc32a9-15ea-53ca-9262-5ba92153839e
2026-01-28 20:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7fc32a9-15ea-53ca-9262-5ba92153839e, skipping ID generation
2026-01-28 20:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7fc32a9-15ea-53ca-9262-5ba92153839e with scrape type 1
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c7fc32a9-15ea-53ca-9262-5ba92153839e from tracking dictionaries
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7fc32a9-15ea-53ca-9262-5ba92153839e sending to next pipeline
2026-01-28 20:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c7fc32a9-15ea-53ca-9262-5ba92153839e, identifier: 1878069
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3d150>
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/6.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08890>
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/11.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17061860-ec02-5b94-b333-15e25bd86f50 with identifier: 1878071
2026-01-28 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17061860-ec02-5b94-b333-15e25bd86f50 with identifier: 1878071
2026-01-28 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 17061860-ec02-5b94-b333-15e25bd86f50 spider: ayvens.be
2026-01-28 20:06:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 17061860-ec02-5b94-b333-15e25bd86f50 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '17061860-ec02-5b94-b333-15e25bd86f50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 89157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552090,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662386,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17061860-ec02-5b94-b333-15e25bd86f50/17061860-ec02-5b94-b333-15e25bd86f50_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/35b2e23b9afb435a8c4064506fc17646/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878071%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [ayvens.be] INFO: Saving data for 1878071: {'created_time': 1769630806.156824, 'last_price_update_time': 1769630806.156834, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878071') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c7fc32a9-15ea-53ca-9262-5ba92153839e with identifier: 1878069
2026-01-28 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c7fc32a9-15ea-53ca-9262-5ba92153839e with identifier: 1878069
2026-01-28 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c7fc32a9-15ea-53ca-9262-5ba92153839e spider: ayvens.be
2026-01-28 20:06:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c7fc32a9-15ea-53ca-9262-5ba92153839e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c7fc32a9-15ea-53ca-9262-5ba92153839e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 77095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656954,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 906881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 909043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fc32a9-15ea-53ca-9262-5ba92153839e/c7fc32a9-15ea-53ca-9262-5ba92153839e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/daaa511a55224e5f9fef5bbdd1e3b52b/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878069%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [ayvens.be] INFO: Saving data for 1878069: {'created_time': 1769630806.420571, 'last_price_update_time': 1769630806.420583, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878069') HTTP/1.1" 204 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/10.jpg not downloaded yet
2026-01-28 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/11.jpg not downloaded yet
2026-01-28 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6f10>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/10.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e16590>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/12.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9ab50>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/9.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/12.jpg not downloaded yet
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/13.jpg not downloaded yet
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e247d0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/13.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de68d0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F91a9f510e1dc409383ab27a4a4782903%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/5.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0beaee04-0107-5431-9930-b50ab61004aa
2026-01-28 20:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0beaee04-0107-5431-9930-b50ab61004aa, skipping ID generation
2026-01-28 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0beaee04-0107-5431-9930-b50ab61004aa with scrape type 1
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0beaee04-0107-5431-9930-b50ab61004aa from tracking dictionaries
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0beaee04-0107-5431-9930-b50ab61004aa sending to next pipeline
2026-01-28 20:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0beaee04-0107-5431-9930-b50ab61004aa, identifier: 1878066
2026-01-28 20:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0beaee04-0107-5431-9930-b50ab61004aa with identifier: 1878066
2026-01-28 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0beaee04-0107-5431-9930-b50ab61004aa with identifier: 1878066
2026-01-28 20:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0beaee04-0107-5431-9930-b50ab61004aa with identifier: 1878066 to the API
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '0beaee04-0107-5431-9930-b50ab61004aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 62297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0beaee04-0107-5431-9930-b50ab61004aa/0beaee04-0107-5431-9930-b50ab61004aa_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/91a9f510e1dc409383ab27a4a4782903/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878066%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [ayvens.be] INFO: Saving data for 1878066: {'created_time': 1769630808.582057, 'last_price_update_time': 1769630808.582071, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878066') HTTP/1.1" 204 0
2026-01-28 20:06:48 [ayvens.be] INFO: Found listing with ID: 1879013
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879013%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [ayvens.be] INFO: Scrape type for 1879013: 1
2026-01-28 20:06:48 [ayvens.be] INFO: Extracting data for car ID: 1879013
2026-01-28 20:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04722b89-fed3-5a74-bbd4-28c80c9c1d99 with identifier: 1879013
2026-01-28 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99 with scrape type 1
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/1.jpg not downloaded yet
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/2.jpg not downloaded yet
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77e50>
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/11.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1f510>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/19.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2ef50>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/1.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edae50>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/3.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1e850>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252F16e36f06551c4c8ea0b97eebf732abd2%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/14.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c
2026-01-28 20:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c, skipping ID generation
2026-01-28 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c with scrape type 1
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c from tracking dictionaries
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dbff58b-eb4c-5e15-9473-48cd64f59e5c sending to next pipeline
2026-01-28 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c, identifier: 1879011
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/3.jpg not downloaded yet
2026-01-28 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c with identifier: 1879011
2026-01-28 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c with identifier: 1879011
2026-01-28 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 118752 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    118752
2026-01-28 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c spider: ayvens.be
2026-01-28 20:06:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2dbff58b-eb4c-5e15-9473-48cd64f59e5c due to rule: high_mileage_for_make.json, error: 118752 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    118752
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '2dbff58b-eb4c-5e15-9473-48cd64f59e5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 118752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142312,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dbff58b-eb4c-5e15-9473-48cd64f59e5c/2dbff58b-eb4c-5e15-9473-48cd64f59e5c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/16e36f06551c4c8ea0b97eebf732abd2/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879011%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [ayvens.be] INFO: Saving data for 1879011: {'created_time': 1769630810.661548, 'last_price_update_time': 1769630810.661561, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879011') HTTP/1.1" 204 0
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/4.jpg not downloaded yet
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/5.jpg not downloaded yet
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/6.jpg not downloaded yet
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/7.jpg not downloaded yet
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/8.jpg not downloaded yet
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/9.jpg not downloaded yet
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e258d0>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/10.jpg saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5f210>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/4.jpg saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6a710>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/5.jpg saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48610>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/6.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba2d0>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/8.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/10.jpg not downloaded yet
2026-01-28 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/11.jpg not downloaded yet
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d16390>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/2.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0ae10>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fbbae5daedab2465b9f3a982bb1067b6f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/1.jpg saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e
2026-01-28 20:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e, skipping ID generation
2026-01-28 20:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e with scrape type 1
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e from tracking dictionaries
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 595abd60-d19b-5d3e-bb0c-94c0fea6a55e sending to next pipeline
2026-01-28 20:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e, identifier: 1878064
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5db50>
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fa20805b471c346fea192a283f38c7f64%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/11.jpg saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273
2026-01-28 20:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273, skipping ID generation
2026-01-28 20:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 with scrape type 1
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 from tracking dictionaries
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 sending to next pipeline
2026-01-28 20:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273, identifier: 1878063
2026-01-28 20:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e with identifier: 1878064
2026-01-28 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e with identifier: 1878064
2026-01-28 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e spider: ayvens.be
2026-01-28 20:06:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 595abd60-d19b-5d3e-bb0c-94c0fea6a55e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '595abd60-d19b-5d3e-bb0c-94c0fea6a55e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 73241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 798148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 794794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688713,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_595abd60-d19b-5d3e-bb0c-94c0fea6a55e/595abd60-d19b-5d3e-bb0c-94c0fea6a55e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/bbae5daedab2465b9f3a982bb1067b6f/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878064%27 HTTP/1.1" 200 None
2026-01-28 20:06:53 [ayvens.be] INFO: Saving data for 1878064: {'created_time': 1769630813.887347, 'last_price_update_time': 1769630813.887358, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878064') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 with identifier: 1878063
2026-01-28 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 with identifier: 1878063
2026-01-28 20:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 spider: ayvens.be
2026-01-28 20:06:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 819ca744-3e99-5eb7-8e49-1e1d0dcbf273 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '819ca744-3e99-5eb7-8e49-1e1d0dcbf273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 31530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 884484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 947492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759625,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_819ca744-3e99-5eb7-8e49-1e1d0dcbf273/819ca744-3e99-5eb7-8e49-1e1d0dcbf273_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488617,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/a20805b471c346fea192a283f38c7f64/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878063%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [ayvens.be] INFO: Saving data for 1878063: {'created_time': 1769630814.145258, 'last_price_update_time': 1769630814.145275, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878063') HTTP/1.1" 204 0
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/12.jpg not downloaded yet
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/13.jpg not downloaded yet
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de1d50>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/9.jpg saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/14.jpg not downloaded yet
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [ayvens.be] INFO: Found listing with ID: 1879014
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879014%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [ayvens.be] INFO: Scrape type for 1879014: 1
2026-01-28 20:06:54 [ayvens.be] INFO: Extracting data for car ID: 1879014
2026-01-28 20:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b58ae63-7f79-5075-a757-9dd818b534fc with identifier: 1879014
2026-01-28 20:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b58ae63-7f79-5075-a757-9dd818b534fc with scrape type 1
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/1.jpg not downloaded yet
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9b750>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/11.jpg saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31c50>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/10.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f41310>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/12.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d853d0>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/7.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/2.jpg not downloaded yet
2026-01-28 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/3.jpg not downloaded yet
2026-01-28 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efd510>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/9.jpg saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b338d0>
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0376f00c655b454c954369d5dae408d3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/8.jpg saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540
2026-01-28 20:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540, skipping ID generation
2026-01-28 20:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 with scrape type 1
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 from tracking dictionaries
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 sending to next pipeline
2026-01-28 20:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540, identifier: 1878062
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8e06090>
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F966ae10833f947d4bd5c82a4e15df766%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/7.jpg saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9589490b-9ee4-53de-b925-c7d6177d224e
2026-01-28 20:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9589490b-9ee4-53de-b925-c7d6177d224e, skipping ID generation
2026-01-28 20:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9589490b-9ee4-53de-b925-c7d6177d224e with scrape type 1
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9589490b-9ee4-53de-b925-c7d6177d224e from tracking dictionaries
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9589490b-9ee4-53de-b925-c7d6177d224e sending to next pipeline
2026-01-28 20:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9589490b-9ee4-53de-b925-c7d6177d224e, identifier: 1878060
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/4.jpg not downloaded yet
2026-01-28 20:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 with identifier: 1878062
2026-01-28 20:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 with identifier: 1878062
2026-01-28 20:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 spider: ayvens.be
2026-01-28 20:06:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b53bc17b-ab9b-5a60-8ae8-bf0d4317c540 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b53bc17b-ab9b-5a60-8ae8-bf0d4317c540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 42663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b53bc17b-ab9b-5a60-8ae8-bf0d4317c540/b53bc17b-ab9b-5a60-8ae8-bf0d4317c540_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0376f00c655b454c954369d5dae408d3/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878062%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [ayvens.be] INFO: Saving data for 1878062: {'created_time': 1769630817.401569, 'last_price_update_time': 1769630817.40158, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878062') HTTP/1.1" 204 0
2026-01-28 20:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9589490b-9ee4-53de-b925-c7d6177d224e with identifier: 1878060
2026-01-28 20:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9589490b-9ee4-53de-b925-c7d6177d224e with identifier: 1878060
2026-01-28 20:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9589490b-9ee4-53de-b925-c7d6177d224e with identifier: 1878060 to the API
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9589490b-9ee4-53de-b925-c7d6177d224e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 29272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623085,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9589490b-9ee4-53de-b925-c7d6177d224e/9589490b-9ee4-53de-b925-c7d6177d224e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/966ae10833f947d4bd5c82a4e15df766/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878060%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [ayvens.be] INFO: Saving data for 1878060: {'created_time': 1769630817.912086, 'last_price_update_time': 1769630817.912099, 'auction_closing_time': 1770202800.0}
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878060') HTTP/1.1" 204 0
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ff50>
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/3.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/5.jpg not downloaded yet
2026-01-28 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/6.jpg not downloaded yet
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9f90>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dw%252Fd6c51d8e34cd48a6bc8597e0b0aebfba%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/13.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f
2026-01-28 20:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 944e4048-a5ba-5b7e-8226-857dc53ebf8f, skipping ID generation
2026-01-28 20:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f with scrape type 1
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 944e4048-a5ba-5b7e-8226-857dc53ebf8f from tracking dictionaries
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 944e4048-a5ba-5b7e-8226-857dc53ebf8f sending to next pipeline
2026-01-28 20:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 944e4048-a5ba-5b7e-8226-857dc53ebf8f, identifier: 1879012
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de1750>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/1.jpg saved to cache
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6fe50>
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/2.jpg saved to cache
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 944e4048-a5ba-5b7e-8226-857dc53ebf8f with identifier: 1879012
2026-01-28 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 944e4048-a5ba-5b7e-8226-857dc53ebf8f with identifier: 1879012
2026-01-28 20:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 944e4048-a5ba-5b7e-8226-857dc53ebf8f with identifier: 1879012 to the API
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '944e4048-a5ba-5b7e-8226-857dc53ebf8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 58931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 418517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_944e4048-a5ba-5b7e-8226-857dc53ebf8f/944e4048-a5ba-5b7e-8226-857dc53ebf8f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dw/d6c51d8e34cd48a6bc8597e0b0aebfba/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879012%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [ayvens.be] INFO: Saving data for 1879012: {'created_time': 1769630819.834913, 'last_price_update_time': 1769630819.834927, 'auction_closing_time': 1770192000.0}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879012') HTTP/1.1" 204 0
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/7.jpg not downloaded yet
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/8.jpg not downloaded yet
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e483d0>
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/10.jpg saved to cache
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8dad0>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/10.jpg saved to cache
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbf690>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/9.jpg saved to cache
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c07950>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/11.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49690>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/5.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/9.jpg not downloaded yet
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/10.jpg not downloaded yet
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6ebd0>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/8.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d17310>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/4.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cac090>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/12.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/11.jpg not downloaded yet
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/12.jpg not downloaded yet
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a69dd0>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/14.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1effe50>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/7.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9690>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/9.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de0090>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/13.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/13.jpg not downloaded yet
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/14.jpg not downloaded yet
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb43d0>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ab%252F849eb44e67e545329a52057954cbc56c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/6.jpg saved to cache
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99
2026-01-28 20:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04722b89-fed3-5a74-bbd4-28c80c9c1d99, skipping ID generation
2026-01-28 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99 with scrape type 1
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 04722b89-fed3-5a74-bbd4-28c80c9c1d99 from tracking dictionaries
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04722b89-fed3-5a74-bbd4-28c80c9c1d99 sending to next pipeline
2026-01-28 20:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 04722b89-fed3-5a74-bbd4-28c80c9c1d99, identifier: 1879013
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de1590>
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/2.jpg saved to cache
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05a90>
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/1.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 04722b89-fed3-5a74-bbd4-28c80c9c1d99 with identifier: 1879013
2026-01-28 20:07:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 04722b89-fed3-5a74-bbd4-28c80c9c1d99 with identifier: 1879013
2026-01-28 20:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 133717 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    133717
2026-01-28 20:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 04722b89-fed3-5a74-bbd4-28c80c9c1d99 spider: ayvens.be
2026-01-28 20:07:05 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 04722b89-fed3-5a74-bbd4-28c80c9c1d99 due to rule: high_mileage_for_country.json, error: 133717 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    133717
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'MARINE BLUE GLOSS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '04722b89-fed3-5a74-bbd4-28c80c9c1d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 133717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 391744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04722b89-fed3-5a74-bbd4-28c80c9c1d99/04722b89-fed3-5a74-bbd4-28c80c9c1d99_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ab/849eb44e67e545329a52057954cbc56c/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 CORPORATE EDITION',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879013%27 HTTP/1.1" 200 None
2026-01-28 20:07:05 [ayvens.be] INFO: Saving data for 1879013: {'created_time': 1769630825.578746, 'last_price_update_time': 1769630825.578756, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879013') HTTP/1.1" 204 0
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:05 [ayvens.be] INFO: Found listing with ID: 1879015
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879015%27 HTTP/1.1" 200 None
2026-01-28 20:07:05 [ayvens.be] INFO: Scrape type for 1879015: 1
2026-01-28 20:07:05 [ayvens.be] INFO: Extracting data for car ID: 1879015
2026-01-28 20:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77f8fb1-99ad-5659-ac88-b3f958dfaf89 with identifier: 1879015
2026-01-28 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89 with scrape type 1
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/1.jpg not downloaded yet
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/2.jpg not downloaded yet
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbded0>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/4.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52590>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/3.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/3.jpg not downloaded yet
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/4.jpg not downloaded yet
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51c50>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/5.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5f250>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/6.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/5.jpg not downloaded yet
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/6.jpg not downloaded yet
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cad090>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F4f4352b9dbbd471d941adf4252a74106%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/8.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5092a162-3389-5d1f-92dd-b2f04a0a9142
2026-01-28 20:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5092a162-3389-5d1f-92dd-b2f04a0a9142, skipping ID generation
2026-01-28 20:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5092a162-3389-5d1f-92dd-b2f04a0a9142 with scrape type 1
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5092a162-3389-5d1f-92dd-b2f04a0a9142 from tracking dictionaries
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5092a162-3389-5d1f-92dd-b2f04a0a9142 sending to next pipeline
2026-01-28 20:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5092a162-3389-5d1f-92dd-b2f04a0a9142, identifier: 1878059
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbfcd0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/7.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/7.jpg not downloaded yet
2026-01-28 20:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5092a162-3389-5d1f-92dd-b2f04a0a9142 with identifier: 1878059
2026-01-28 20:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5092a162-3389-5d1f-92dd-b2f04a0a9142 with identifier: 1878059
2026-01-28 20:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5092a162-3389-5d1f-92dd-b2f04a0a9142 spider: ayvens.be
2026-01-28 20:07:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5092a162-3389-5d1f-92dd-b2f04a0a9142 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5092a162-3389-5d1f-92dd-b2f04a0a9142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 47715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 835178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5092a162-3389-5d1f-92dd-b2f04a0a9142/5092a162-3389-5d1f-92dd-b2f04a0a9142_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/4f4352b9dbbd471d941adf4252a74106/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878059%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [ayvens.be] INFO: Saving data for 1878059: {'created_time': 1769630828.032153, 'last_price_update_time': 1769630828.032164, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878059') HTTP/1.1" 204 0
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at -1 pages/min), scraped 12 items (at 8 items/min)
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/8.jpg not downloaded yet
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/9.jpg not downloaded yet
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8f1d0>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/18.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1b90>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/9.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d010>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/8.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36910>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/9.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/10.jpg not downloaded yet
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb7050>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/8.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e04110>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fde19688e954a4f1eb3e65bc6be52f37f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/7.jpg saved to cache
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e9abf19-1dca-5314-9063-5589bdaec65b
2026-01-28 20:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e9abf19-1dca-5314-9063-5589bdaec65b, skipping ID generation
2026-01-28 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e9abf19-1dca-5314-9063-5589bdaec65b with scrape type 1
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8e9abf19-1dca-5314-9063-5589bdaec65b from tracking dictionaries
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e9abf19-1dca-5314-9063-5589bdaec65b sending to next pipeline
2026-01-28 20:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e9abf19-1dca-5314-9063-5589bdaec65b, identifier: 1878058
2026-01-28 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e9abf19-1dca-5314-9063-5589bdaec65b with identifier: 1878058
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e9abf19-1dca-5314-9063-5589bdaec65b with identifier: 1878058
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8e9abf19-1dca-5314-9063-5589bdaec65b spider: ayvens.be
2026-01-28 20:07:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8e9abf19-1dca-5314-9063-5589bdaec65b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '8e9abf19-1dca-5314-9063-5589bdaec65b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 38300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 859566,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754945,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607818,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e9abf19-1dca-5314-9063-5589bdaec65b/8e9abf19-1dca-5314-9063-5589bdaec65b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/de19688e954a4f1eb3e65bc6be52f37f/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878058%27 HTTP/1.1" 200 None
2026-01-28 20:07:10 [ayvens.be] INFO: Saving data for 1878058: {'created_time': 1769630830.541591, 'last_price_update_time': 1769630830.5416, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878058') HTTP/1.1" 204 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/11.jpg not downloaded yet
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4a50>
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/11.jpg saved to cache
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08d10>
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/10.jpg saved to cache
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edf790>
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/7.jpg saved to cache
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edde50>
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/13.jpg saved to cache
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edc2d0>
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/12.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/12.jpg not downloaded yet
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f212d0>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2en%252F6d745810b55e4f28b915678b3dbcb0c9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/14.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6b58ae63-7f79-5075-a757-9dd818b534fc
2026-01-28 20:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b58ae63-7f79-5075-a757-9dd818b534fc, skipping ID generation
2026-01-28 20:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b58ae63-7f79-5075-a757-9dd818b534fc with scrape type 1
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b58ae63-7f79-5075-a757-9dd818b534fc from tracking dictionaries
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b58ae63-7f79-5075-a757-9dd818b534fc sending to next pipeline
2026-01-28 20:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6b58ae63-7f79-5075-a757-9dd818b534fc, identifier: 1879014
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/13.jpg not downloaded yet
2026-01-28 20:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6b58ae63-7f79-5075-a757-9dd818b534fc with identifier: 1879014
2026-01-28 20:07:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6b58ae63-7f79-5075-a757-9dd818b534fc with identifier: 1879014
2026-01-28 20:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 1 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    1
2026-01-28 20:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: LOW_MILEAGE_FOR_COUNTRY failed for item: 6b58ae63-7f79-5075-a757-9dd818b534fc spider: ayvens.be
2026-01-28 20:07:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6b58ae63-7f79-5075-a757-9dd818b534fc due to rule: low_mileage_for_country.json, error: 1 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    1
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'SCALE SILVER METALLISEE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '6b58ae63-7f79-5075-a757-9dd818b534fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393202,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b58ae63-7f79-5075-a757-9dd818b534fc/6b58ae63-7f79-5075-a757-9dd818b534fc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2en/6d745810b55e4f28b915678b3dbcb0c9/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 128KW PRO BUSINESS',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 128KW PRO BUSINESS',
 'vin': None,
 'year': 2023}
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879014%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [ayvens.be] INFO: Saving data for 1879014: {'created_time': 1769630832.694083, 'last_price_update_time': 1769630832.694095, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879014') HTTP/1.1" 204 0
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [ayvens.be] INFO: Found listing with ID: 1879016
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879016%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [ayvens.be] INFO: Scrape type for 1879016: 1
2026-01-28 20:07:12 [ayvens.be] INFO: Extracting data for car ID: 1879016
2026-01-28 20:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5392236-32c0-51e5-8b1a-4b4491c52168 with identifier: 1879016
2026-01-28 20:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5392236-32c0-51e5-8b1a-4b4491c52168 with scrape type 1
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/1.jpg not downloaded yet
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/2.jpg not downloaded yet
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/3.jpg not downloaded yet
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/4.jpg not downloaded yet
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/5.jpg not downloaded yet
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c5ae90>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fbe445f9184a5462ea5b1da821c3df93e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/6.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9ebff37-fa8d-5538-b913-772e17544ecf
2026-01-28 20:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9ebff37-fa8d-5538-b913-772e17544ecf, skipping ID generation
2026-01-28 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ebff37-fa8d-5538-b913-772e17544ecf with scrape type 1
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a9ebff37-fa8d-5538-b913-772e17544ecf from tracking dictionaries
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9ebff37-fa8d-5538-b913-772e17544ecf sending to next pipeline
2026-01-28 20:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a9ebff37-fa8d-5538-b913-772e17544ecf, identifier: 1878053
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/6.jpg not downloaded yet
2026-01-28 20:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a9ebff37-fa8d-5538-b913-772e17544ecf with identifier: 1878053
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a9ebff37-fa8d-5538-b913-772e17544ecf with identifier: 1878053
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a9ebff37-fa8d-5538-b913-772e17544ecf spider: ayvens.be
2026-01-28 20:07:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a9ebff37-fa8d-5538-b913-772e17544ecf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a9ebff37-fa8d-5538-b913-772e17544ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655564,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 791374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 852340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612445,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680831,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ebff37-fa8d-5538-b913-772e17544ecf/a9ebff37-fa8d-5538-b913-772e17544ecf_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/be445f9184a5462ea5b1da821c3df93e/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878053%27 HTTP/1.1" 200 None
2026-01-28 20:07:13 [ayvens.be] INFO: Saving data for 1878053: {'created_time': 1769630833.444715, 'last_price_update_time': 1769630833.444725, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878053') HTTP/1.1" 204 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/7.jpg not downloaded yet
2026-01-28 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84210>
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252Fbd01b91dbf004bb1b2b0bd15bec6c014%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/17.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9be839c4-b87f-5b57-bd5e-5e2962713f76
2026-01-28 20:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9be839c4-b87f-5b57-bd5e-5e2962713f76, skipping ID generation
2026-01-28 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be839c4-b87f-5b57-bd5e-5e2962713f76 with scrape type 1
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9be839c4-b87f-5b57-bd5e-5e2962713f76 from tracking dictionaries
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9be839c4-b87f-5b57-bd5e-5e2962713f76 sending to next pipeline
2026-01-28 20:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9be839c4-b87f-5b57-bd5e-5e2962713f76, identifier: 1878052
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee06d0>
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/3.jpg saved to cache
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c64350>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/6.jpg saved to cache
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccec50>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/1.jpg saved to cache
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ecd0>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/14.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3c090>
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/2.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65110>
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/4.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/8.jpg not downloaded yet
2026-01-28 20:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9be839c4-b87f-5b57-bd5e-5e2962713f76 with identifier: 1878052
2026-01-28 20:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9be839c4-b87f-5b57-bd5e-5e2962713f76 with identifier: 1878052
2026-01-28 20:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9be839c4-b87f-5b57-bd5e-5e2962713f76 spider: ayvens.be
2026-01-28 20:07:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9be839c4-b87f-5b57-bd5e-5e2962713f76 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '9be839c4-b87f-5b57-bd5e-5e2962713f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 72465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658240,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764305,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9be839c4-b87f-5b57-bd5e-5e2962713f76/9be839c4-b87f-5b57-bd5e-5e2962713f76_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/bd01b91dbf004bb1b2b0bd15bec6c014/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878052%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [ayvens.be] INFO: Saving data for 1878052: {'created_time': 1769630836.030564, 'last_price_update_time': 1769630836.030576, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878052') HTTP/1.1" 204 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/9.jpg not downloaded yet
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34590>
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/9.jpg saved to cache
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/10.jpg not downloaded yet
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e99d0>
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/5.jpg saved to cache
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ced450>
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/8.jpg saved to cache
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/11.jpg not downloaded yet
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec48d0>
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252Fb0644628310c491887b82fb54ee88d57%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/13.jpg saved to cache
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 548af6aa-a894-53ec-97c4-25b21a3b99cf
2026-01-28 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 548af6aa-a894-53ec-97c4-25b21a3b99cf, skipping ID generation
2026-01-28 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 548af6aa-a894-53ec-97c4-25b21a3b99cf with scrape type 1
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 548af6aa-a894-53ec-97c4-25b21a3b99cf from tracking dictionaries
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 548af6aa-a894-53ec-97c4-25b21a3b99cf sending to next pipeline
2026-01-28 20:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 548af6aa-a894-53ec-97c4-25b21a3b99cf, identifier: 1878051
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/12.jpg not downloaded yet
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 548af6aa-a894-53ec-97c4-25b21a3b99cf with identifier: 1878051
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 548af6aa-a894-53ec-97c4-25b21a3b99cf with identifier: 1878051
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 548af6aa-a894-53ec-97c4-25b21a3b99cf spider: ayvens.be
2026-01-28 20:07:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 548af6aa-a894-53ec-97c4-25b21a3b99cf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '548af6aa-a894-53ec-97c4-25b21a3b99cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 47439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565739,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632622,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_548af6aa-a894-53ec-97c4-25b21a3b99cf/548af6aa-a894-53ec-97c4-25b21a3b99cf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/b0644628310c491887b82fb54ee88d57/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878051%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [ayvens.be] INFO: Saving data for 1878051: {'created_time': 1769630837.725546, 'last_price_update_time': 1769630837.725555, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878051') HTTP/1.1" 204 0
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/13.jpg not downloaded yet
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8f050>
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/7.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2deba90>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/6.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8e590>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F52e94949419546e0a87821f2a6390419%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/5.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 189c43f5-f63a-534c-84df-4844fb6493a1
2026-01-28 20:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 189c43f5-f63a-534c-84df-4844fb6493a1, skipping ID generation
2026-01-28 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189c43f5-f63a-534c-84df-4844fb6493a1 with scrape type 1
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 189c43f5-f63a-534c-84df-4844fb6493a1 from tracking dictionaries
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 189c43f5-f63a-534c-84df-4844fb6493a1 sending to next pipeline
2026-01-28 20:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 189c43f5-f63a-534c-84df-4844fb6493a1, identifier: 1878050
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edbf10>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fa6fc66ff9d5d40b382d16b599e2f4fb9%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/17.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e
2026-01-28 20:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e, skipping ID generation
2026-01-28 20:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e with scrape type 1
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e from tracking dictionaries
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 128f0dd1-5a97-5fb8-aabf-0d066c108c3e sending to next pipeline
2026-01-28 20:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e, identifier: 1878049
2026-01-28 20:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 189c43f5-f63a-534c-84df-4844fb6493a1 with identifier: 1878050
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 189c43f5-f63a-534c-84df-4844fb6493a1 with identifier: 1878050
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 189c43f5-f63a-534c-84df-4844fb6493a1 spider: ayvens.be
2026-01-28 20:07:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 189c43f5-f63a-534c-84df-4844fb6493a1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '189c43f5-f63a-534c-84df-4844fb6493a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 56605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 770251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_189c43f5-f63a-534c-84df-4844fb6493a1/189c43f5-f63a-534c-84df-4844fb6493a1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/52e94949419546e0a87821f2a6390419/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878050%27 HTTP/1.1" 200 None
2026-01-28 20:07:19 [ayvens.be] INFO: Saving data for 1878050: {'created_time': 1769630839.473222, 'last_price_update_time': 1769630839.473231, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878050') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e with identifier: 1878049
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e with identifier: 1878049
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e spider: ayvens.be
2026-01-28 20:07:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 128f0dd1-5a97-5fb8-aabf-0d066c108c3e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '128f0dd1-5a97-5fb8-aabf-0d066c108c3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 96540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 833266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754328,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561107,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_128f0dd1-5a97-5fb8-aabf-0d066c108c3e/128f0dd1-5a97-5fb8-aabf-0d066c108c3e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679616,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/a6fc66ff9d5d40b382d16b599e2f4fb9/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878049%27 HTTP/1.1" 200 None
2026-01-28 20:07:19 [ayvens.be] INFO: Saving data for 1878049: {'created_time': 1769630839.792376, 'last_price_update_time': 1769630839.79239, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878049') HTTP/1.1" 204 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/14.jpg not downloaded yet
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46fd0>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/1.jpg saved to cache
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [ayvens.be] INFO: Found listing with ID: 1879017
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879017%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [ayvens.be] INFO: Scrape type for 1879017: 1
2026-01-28 20:07:20 [ayvens.be] INFO: Extracting data for car ID: 1879017
2026-01-28 20:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with identifier: 1879017
2026-01-28 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with scrape type 1
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/1.jpg not downloaded yet
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30803d0>
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/13.jpg saved to cache
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c444d0>
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/12.jpg saved to cache
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/2.jpg not downloaded yet
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/3.jpg not downloaded yet
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e55410>
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/10.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28850>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252F6e7852df4b8d4d34ba5bb68bf7c9ef75%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/11.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89
2026-01-28 20:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e77f8fb1-99ad-5659-ac88-b3f958dfaf89, skipping ID generation
2026-01-28 20:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89 with scrape type 1
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e77f8fb1-99ad-5659-ac88-b3f958dfaf89 from tracking dictionaries
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e77f8fb1-99ad-5659-ac88-b3f958dfaf89 sending to next pipeline
2026-01-28 20:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e77f8fb1-99ad-5659-ac88-b3f958dfaf89, identifier: 1879015
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5550>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/2.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e77f8fb1-99ad-5659-ac88-b3f958dfaf89 with identifier: 1879015
2026-01-28 20:07:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e77f8fb1-99ad-5659-ac88-b3f958dfaf89 with identifier: 1879015
2026-01-28 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148294 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148294
2026-01-28 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e77f8fb1-99ad-5659-ac88-b3f958dfaf89 spider: ayvens.be
2026-01-28 20:07:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e77f8fb1-99ad-5659-ac88-b3f958dfaf89 due to rule: high_mileage_for_country.json, error: 148294 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148294
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'QUARTZ GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e77f8fb1-99ad-5659-ac88-b3f958dfaf89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI - 2019',
 'odometer': 148294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294822,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77f8fb1-99ad-5659-ac88-b3f958dfaf89/e77f8fb1-99ad-5659-ac88-b3f958dfaf89_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/6e7852df4b8d4d34ba5bb68bf7c9ef75/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI - 2019 1.4 TSI PHEV L&K DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV L&K DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879015%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [ayvens.be] INFO: Saving data for 1879015: {'created_time': 1769630842.098983, 'last_price_update_time': 1769630842.098994, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879015') HTTP/1.1" 204 0
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/4.jpg not downloaded yet
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/5.jpg not downloaded yet
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0c650>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/7.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d17ed0>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/6.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34250>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/5.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/6.jpg not downloaded yet
2026-01-28 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/7.jpg not downloaded yet
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec2b10>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252Fb8000e2e00bf4e88ae5790689fbb266b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/11.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c
2026-01-28 20:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ebbd11f-439a-5ca5-99e2-abe488162c7c, skipping ID generation
2026-01-28 20:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c with scrape type 1
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5ebbd11f-439a-5ca5-99e2-abe488162c7c from tracking dictionaries
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ebbd11f-439a-5ca5-99e2-abe488162c7c sending to next pipeline
2026-01-28 20:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ebbd11f-439a-5ca5-99e2-abe488162c7c, identifier: 1878048
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35050>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/13.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded4d0>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/9.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8f23c10>
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/10.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ebbd11f-439a-5ca5-99e2-abe488162c7c with identifier: 1878048
2026-01-28 20:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ebbd11f-439a-5ca5-99e2-abe488162c7c with identifier: 1878048
2026-01-28 20:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5ebbd11f-439a-5ca5-99e2-abe488162c7c spider: ayvens.be
2026-01-28 20:07:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5ebbd11f-439a-5ca5-99e2-abe488162c7c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': '5ebbd11f-439a-5ca5-99e2-abe488162c7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 61699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653748,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 857524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 825076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 962877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ebbd11f-439a-5ca5-99e2-abe488162c7c/5ebbd11f-439a-5ca5-99e2-abe488162c7c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/b8000e2e00bf4e88ae5790689fbb266b/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878048%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [ayvens.be] INFO: Saving data for 1878048: {'created_time': 1769630844.687881, 'last_price_update_time': 1769630844.687891, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878048') HTTP/1.1" 204 0
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/8.jpg not downloaded yet
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/9.jpg not downloaded yet
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0da10>
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/8.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49f50>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/11.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14a90>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/3.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/10.jpg not downloaded yet
2026-01-28 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/11.jpg not downloaded yet
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49c10>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/4.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26850>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/13.jpg saved to cache
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/12.jpg not downloaded yet
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/13.jpg not downloaded yet
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b248d0>
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/12.jpg saved to cache
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e53490>
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/2.jpg saved to cache
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24a90>
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F0de45dbd792c45fd937090af898fc6f5%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/14.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d5392236-32c0-51e5-8b1a-4b4491c52168
2026-01-28 20:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5392236-32c0-51e5-8b1a-4b4491c52168, skipping ID generation
2026-01-28 20:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5392236-32c0-51e5-8b1a-4b4491c52168 with scrape type 1
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d5392236-32c0-51e5-8b1a-4b4491c52168 from tracking dictionaries
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5392236-32c0-51e5-8b1a-4b4491c52168 sending to next pipeline
2026-01-28 20:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d5392236-32c0-51e5-8b1a-4b4491c52168, identifier: 1879016
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfbc50>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/4.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/14.jpg not downloaded yet
2026-01-28 20:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d5392236-32c0-51e5-8b1a-4b4491c52168 with identifier: 1879016
2026-01-28 20:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d5392236-32c0-51e5-8b1a-4b4491c52168 with identifier: 1879016
2026-01-28 20:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d5392236-32c0-51e5-8b1a-4b4491c52168 with identifier: 1879016 to the API
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd5392236-32c0-51e5-8b1a-4b4491c52168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 8136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 390624,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5392236-32c0-51e5-8b1a-4b4491c52168/d5392236-32c0-51e5-8b1a-4b4491c52168_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/0de45dbd792c45fd937090af898fc6f5/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA 1.0 TSI 81KW DSG CLEVER+',
 'transmission': 'automatic',
 'trim': '1.0 TSI 81KW DSG CLEVER+',
 'vin': None,
 'year': 2022}
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879016%27 HTTP/1.1" 200 None
2026-01-28 20:07:28 [ayvens.be] INFO: Saving data for 1879016: {'created_time': 1769630848.009265, 'last_price_update_time': 1769630848.009275, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879016') HTTP/1.1" 204 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/15.jpg not downloaded yet
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6ee50>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bf%252F082645e192f44af5a087fe1ab5da405e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/3.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b
2026-01-28 20:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdb4172a-2180-5f1f-acb7-6d958ab13c1b, skipping ID generation
2026-01-28 20:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b with scrape type 1
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cdb4172a-2180-5f1f-acb7-6d958ab13c1b from tracking dictionaries
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdb4172a-2180-5f1f-acb7-6d958ab13c1b sending to next pipeline
2026-01-28 20:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cdb4172a-2180-5f1f-acb7-6d958ab13c1b, identifier: 1878042
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f23650>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/1.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2350>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/3.jpg saved to cache
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e504d0>
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/4.jpg saved to cache
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cdb4172a-2180-5f1f-acb7-6d958ab13c1b with identifier: 1878042
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cdb4172a-2180-5f1f-acb7-6d958ab13c1b with identifier: 1878042
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cdb4172a-2180-5f1f-acb7-6d958ab13c1b spider: ayvens.be
2026-01-28 20:07:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: cdb4172a-2180-5f1f-acb7-6d958ab13c1b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T11:00:00Z',
 'fuel_type': 'diesel',
 'id': 'cdb4172a-2180-5f1f-acb7-6d958ab13c1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39160',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 44966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649044,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 734016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 832908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582327,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdb4172a-2180-5f1f-acb7-6d958ab13c1b/cdb4172a-2180-5f1f-acb7-6d958ab13c1b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bf/082645e192f44af5a087fe1ab5da405e/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878042%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [ayvens.be] INFO: Saving data for 1878042: {'created_time': 1769630849.642912, 'last_price_update_time': 1769630849.642925, 'auction_closing_time': 1770202800.0}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878042') HTTP/1.1" 204 0
2026-01-28 20:07:29 [ayvens.be] INFO: Found listing with ID: 1879018
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879018%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [ayvens.be] INFO: Scrape type for 1879018: 1
2026-01-28 20:07:29 [ayvens.be] INFO: Extracting data for car ID: 1879018
2026-01-28 20:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adccccbc-0a94-5ccb-a7eb-7a79da4a7746 with identifier: 1879018
2026-01-28 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746 with scrape type 1
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/1.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/2.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/3.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/4.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/5.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/6.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/7.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/8.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/9.jpg not downloaded yet
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15550>
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/6.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0a90>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/9.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d53590>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/8.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85350>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/5.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51590>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/7.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec42d0>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/10.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/10.jpg not downloaded yet
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31710>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/11.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd37d0>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/12.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/11.jpg not downloaded yet
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce85d0>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/15.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/12.jpg not downloaded yet
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/13.jpg not downloaded yet
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d59490>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/13.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48d90>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/3.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98250>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252Fefade476b1e14fe1952165f8607472e7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/14.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7
2026-01-28 20:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7, skipping ID generation
2026-01-28 20:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with scrape type 1
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 from tracking dictionaries
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 sending to next pipeline
2026-01-28 20:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7, identifier: 1879017
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf0a50>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/1.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05d90>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/4.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with identifier: 1879017
2026-01-28 20:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with identifier: 1879017
2026-01-28 20:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7 with identifier: 1879017 to the API
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES ACTIVE TOURER',
 'odometer': 105324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424707,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7/ba69dc98-5d2e-5365-ad8d-fd3ba865a3d7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/efade476b1e14fe1952165f8607472e7/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES ACTIVE TOURER 1.5 216D ACTIVE TOURER',
 'transmission': 'manual',
 'trim': '1.5 216D ACTIVE TOURER',
 'vin': None,
 'year': 2023}
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879017%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [ayvens.be] INFO: Saving data for 1879017: {'created_time': 1769630854.75798, 'last_price_update_time': 1769630854.75799, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879017') HTTP/1.1" 204 0
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [ayvens.be] INFO: Found listing with ID: 1879019
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879019%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [ayvens.be] INFO: Scrape type for 1879019: 1
2026-01-28 20:07:34 [ayvens.be] INFO: Extracting data for car ID: 1879019
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354b3541-5a6e-5860-98fe-a8018bb6c76c with identifier: 1879019
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354b3541-5a6e-5860-98fe-a8018bb6c76c with scrape type 1
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/1.jpg not downloaded yet
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75590>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/2.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d310>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/5.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/2.jpg not downloaded yet
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/3.jpg not downloaded yet
2026-01-28 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30eb250>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/7.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e142d0>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/6.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbf490>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/8.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/4.jpg not downloaded yet
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/5.jpg not downloaded yet
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecf2d0>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/9.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e23cd0>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/10.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3f10>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/11.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed9210>
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/12.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/6.jpg not downloaded yet
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/7.jpg not downloaded yet
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/8.jpg not downloaded yet
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/9.jpg not downloaded yet
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/10.jpg not downloaded yet
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/11.jpg not downloaded yet
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/12.jpg not downloaded yet
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4ebd0>
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fc87eafa18fd24f589f8f29d2f03ff7b3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/13.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746
2026-01-28 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adccccbc-0a94-5ccb-a7eb-7a79da4a7746, skipping ID generation
2026-01-28 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746 with scrape type 1
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item adccccbc-0a94-5ccb-a7eb-7a79da4a7746 from tracking dictionaries
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adccccbc-0a94-5ccb-a7eb-7a79da4a7746 sending to next pipeline
2026-01-28 20:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: adccccbc-0a94-5ccb-a7eb-7a79da4a7746, identifier: 1879018
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2c390>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/1.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/13.jpg not downloaded yet
2026-01-28 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: adccccbc-0a94-5ccb-a7eb-7a79da4a7746 with identifier: 1879018
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: adccccbc-0a94-5ccb-a7eb-7a79da4a7746 with identifier: 1879018
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: adccccbc-0a94-5ccb-a7eb-7a79da4a7746 spider: ayvens.be
2026-01-28 20:07:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: adccccbc-0a94-5ccb-a7eb-7a79da4a7746 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'adccccbc-0a94-5ccb-a7eb-7a79da4a7746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 96312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adccccbc-0a94-5ccb-a7eb-7a79da4a7746/adccccbc-0a94-5ccb-a7eb-7a79da4a7746_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/c87eafa18fd24f589f8f29d2f03ff7b3/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1',
 'vin': None,
 'year': 2022}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879018%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [ayvens.be] INFO: Saving data for 1879018: {'created_time': 1769630858.721446, 'last_price_update_time': 1769630858.721458, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879018') HTTP/1.1" 204 0
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [ayvens.be] INFO: Found listing with ID: 1879020
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879020%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [ayvens.be] INFO: Scrape type for 1879020: 1
2026-01-28 20:07:38 [ayvens.be] INFO: Extracting data for car ID: 1879020
2026-01-28 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f747bc2b-2519-5622-a3df-d88c2897e06c with identifier: 1879020
2026-01-28 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f747bc2b-2519-5622-a3df-d88c2897e06c with scrape type 1
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/1.jpg not downloaded yet
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5d550>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/3.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e8450>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/2.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbadaf51690>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/6.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/2.jpg not downloaded yet
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6690>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/5.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/3.jpg not downloaded yet
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08510>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/4.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b526d0>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/8.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a090>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/7.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/4.jpg not downloaded yet
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2b90>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/9.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d53c90>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/10.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/5.jpg not downloaded yet
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/6.jpg not downloaded yet
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/7.jpg not downloaded yet
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/8.jpg not downloaded yet
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/9.jpg not downloaded yet
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/10.jpg not downloaded yet
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/11.jpg not downloaded yet
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5b050>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/13.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/12.jpg not downloaded yet
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba8d0>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/11.jpg saved to cache
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4990>
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ct%252F1c7cb9a69b0e43309c41cc12d0cbc0ab%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/12.jpg saved to cache
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 354b3541-5a6e-5860-98fe-a8018bb6c76c
2026-01-28 20:07:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 354b3541-5a6e-5860-98fe-a8018bb6c76c, skipping ID generation
2026-01-28 20:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354b3541-5a6e-5860-98fe-a8018bb6c76c with scrape type 1
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 354b3541-5a6e-5860-98fe-a8018bb6c76c from tracking dictionaries
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 354b3541-5a6e-5860-98fe-a8018bb6c76c sending to next pipeline
2026-01-28 20:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 354b3541-5a6e-5860-98fe-a8018bb6c76c, identifier: 1879019
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/13.jpg not downloaded yet
2026-01-28 20:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 354b3541-5a6e-5860-98fe-a8018bb6c76c with identifier: 1879019
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 354b3541-5a6e-5860-98fe-a8018bb6c76c with identifier: 1879019
2026-01-28 20:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 354b3541-5a6e-5860-98fe-a8018bb6c76c with identifier: 1879019 to the API
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '354b3541-5a6e-5860-98fe-a8018bb6c76c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 88282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247775,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505427,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_354b3541-5a6e-5860-98fe-a8018bb6c76c/354b3541-5a6e-5860-98fe-a8018bb6c76c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220645,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ct/1c7cb9a69b0e43309c41cc12d0cbc0ab/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ATTRACTION AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ATTRACTION AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879019%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [ayvens.be] INFO: Saving data for 1879019: {'created_time': 1769630862.998429, 'last_price_update_time': 1769630862.998442, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879019') HTTP/1.1" 204 0
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [ayvens.be] INFO: Found listing with ID: 1879021
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879021%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [ayvens.be] INFO: Scrape type for 1879021: 1
2026-01-28 20:07:43 [ayvens.be] INFO: Extracting data for car ID: 1879021
2026-01-28 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8206591f-beff-5fdd-ab4c-4aad4de01f14 with identifier: 1879021
2026-01-28 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8206591f-beff-5fdd-ab4c-4aad4de01f14 with scrape type 1
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/1.jpg not downloaded yet
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d59ed0>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/1.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0250>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/2.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0be50>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/6.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/2.jpg not downloaded yet
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1b110>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/5.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e202d0>
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/9.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e2d0>
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/4.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/3.jpg not downloaded yet
2026-01-28 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/4.jpg not downloaded yet
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87410>
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/3.jpg saved to cache
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e790>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/8.jpg saved to cache
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee5390>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/7.jpg saved to cache
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/5.jpg not downloaded yet
2026-01-28 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/6.jpg not downloaded yet
2026-01-28 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbf410>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/10.jpg saved to cache
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0a250>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/11.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/7.jpg not downloaded yet
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/8.jpg not downloaded yet
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e14490>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/12.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7b90>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dx%252Fd45dbb2551164f38a1c482f4be416e26%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/13.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f747bc2b-2519-5622-a3df-d88c2897e06c
2026-01-28 20:07:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f747bc2b-2519-5622-a3df-d88c2897e06c, skipping ID generation
2026-01-28 20:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f747bc2b-2519-5622-a3df-d88c2897e06c with scrape type 1
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f747bc2b-2519-5622-a3df-d88c2897e06c from tracking dictionaries
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f747bc2b-2519-5622-a3df-d88c2897e06c sending to next pipeline
2026-01-28 20:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f747bc2b-2519-5622-a3df-d88c2897e06c, identifier: 1879020
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f747bc2b-2519-5622-a3df-d88c2897e06c with identifier: 1879020
2026-01-28 20:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f747bc2b-2519-5622-a3df-d88c2897e06c with identifier: 1879020
2026-01-28 20:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f747bc2b-2519-5622-a3df-d88c2897e06c with identifier: 1879020 to the API
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': 'f747bc2b-2519-5622-a3df-d88c2897e06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 81294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214592,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 153608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f747bc2b-2519-5622-a3df-d88c2897e06c/f747bc2b-2519-5622-a3df-d88c2897e06c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dx/d45dbb2551164f38a1c482f4be416e26/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE ULTIMATE',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE ULTIMATE',
 'vin': None,
 'year': 2023}
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879020%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [ayvens.be] INFO: Saving data for 1879020: {'created_time': 1769630867.909181, 'last_price_update_time': 1769630867.90919, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879020') HTTP/1.1" 204 0
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/9.jpg not downloaded yet
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/10.jpg not downloaded yet
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecfb10>
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/2.jpg saved to cache
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/11.jpg not downloaded yet
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/12.jpg not downloaded yet
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c850>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/1.jpg saved to cache
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f710>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/3.jpg saved to cache
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d890>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/4.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/13.jpg not downloaded yet
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/14.jpg not downloaded yet
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e17110>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/6.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec650>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/5.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:50 [ayvens.be] INFO: Found listing with ID: 1879022
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879022%27 HTTP/1.1" 200 None
2026-01-28 20:07:50 [ayvens.be] INFO: Scrape type for 1879022: 1
2026-01-28 20:07:50 [ayvens.be] INFO: Extracting data for car ID: 1879022
2026-01-28 20:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cff01f-d26c-5b0f-9a7c-d335777321b5 with identifier: 1879022
2026-01-28 20:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cff01f-d26c-5b0f-9a7c-d335777321b5 with scrape type 1
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/1.jpg not downloaded yet
2026-01-28 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85790>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/7.jpg saved to cache
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de04d0>
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/8.jpg saved to cache
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/2.jpg not downloaded yet
2026-01-28 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/3.jpg not downloaded yet
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2a110>
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/9.jpg saved to cache
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def250>
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/10.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/4.jpg not downloaded yet
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53050>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/11.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3e6d0>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/12.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/5.jpg not downloaded yet
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/6.jpg not downloaded yet
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61cd0>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/13.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/7.jpg not downloaded yet
2026-01-28 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5ac90>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/1.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/8.jpg not downloaded yet
2026-01-28 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/9.jpg not downloaded yet
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f288d0>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gn%252F1ecd5e807013408e96554e1d1c39dd81%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/14.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8206591f-beff-5fdd-ab4c-4aad4de01f14
2026-01-28 20:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8206591f-beff-5fdd-ab4c-4aad4de01f14, skipping ID generation
2026-01-28 20:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8206591f-beff-5fdd-ab4c-4aad4de01f14 with scrape type 1
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8206591f-beff-5fdd-ab4c-4aad4de01f14 from tracking dictionaries
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8206591f-beff-5fdd-ab4c-4aad4de01f14 sending to next pipeline
2026-01-28 20:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8206591f-beff-5fdd-ab4c-4aad4de01f14, identifier: 1879021
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad98fdb10>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/2.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8206591f-beff-5fdd-ab4c-4aad4de01f14 with identifier: 1879021
2026-01-28 20:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8206591f-beff-5fdd-ab4c-4aad4de01f14 with identifier: 1879021
2026-01-28 20:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8206591f-beff-5fdd-ab4c-4aad4de01f14 with identifier: 1879021 to the API
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '8206591f-beff-5fdd-ab4c-4aad4de01f14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'JEEP',
 'model': 'AVENGER',
 'odometer': 13334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306678,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305244,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8206591f-beff-5fdd-ab4c-4aad4de01f14/8206591f-beff-5fdd-ab4c-4aad4de01f14_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gn/1ecd5e807013408e96554e1d1c39dd81/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JEEP AVENGER BEV 54KWH SUMMIT',
 'transmission': 'automatic',
 'trim': 'BEV 54KWH SUMMIT',
 'vin': None,
 'year': 2025}
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879021%27 HTTP/1.1" 200 None
2026-01-28 20:07:54 [ayvens.be] INFO: Saving data for 1879021: {'created_time': 1769630874.648429, 'last_price_update_time': 1769630874.648444, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879021') HTTP/1.1" 204 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/10.jpg not downloaded yet
2026-01-28 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2fb90>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/4.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a410>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/3.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/11.jpg not downloaded yet
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/12.jpg not downloaded yet
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d870d0>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/5.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/13.jpg not downloaded yet
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [ayvens.be] INFO: Found listing with ID: 1879023
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879023%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [ayvens.be] INFO: Scrape type for 1879023: 1
2026-01-28 20:07:55 [ayvens.be] INFO: Extracting data for car ID: 1879023
2026-01-28 20:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d07c406e-73b1-5469-ae5d-162ac0517c45 with identifier: 1879023
2026-01-28 20:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07c406e-73b1-5469-ae5d-162ac0517c45 with scrape type 1
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/1.jpg not downloaded yet
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/2.jpg not downloaded yet
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/3.jpg not downloaded yet
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/4.jpg not downloaded yet
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/5.jpg not downloaded yet
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f481d0>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/6.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ac10>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/7.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/6.jpg not downloaded yet
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58810>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/8.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/7.jpg not downloaded yet
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e7d0>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/9.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1e390>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/10.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/8.jpg not downloaded yet
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e176d0>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/11.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/9.jpg not downloaded yet
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22b50>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/12.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ef90>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/1.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ff10>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wx%252F2cb38ffc8b624f5daa0aac068629c215%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/13.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d3cff01f-d26c-5b0f-9a7c-d335777321b5
2026-01-28 20:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3cff01f-d26c-5b0f-9a7c-d335777321b5, skipping ID generation
2026-01-28 20:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cff01f-d26c-5b0f-9a7c-d335777321b5 with scrape type 1
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d3cff01f-d26c-5b0f-9a7c-d335777321b5 from tracking dictionaries
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3cff01f-d26c-5b0f-9a7c-d335777321b5 sending to next pipeline
2026-01-28 20:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3cff01f-d26c-5b0f-9a7c-d335777321b5, identifier: 1879022
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/10.jpg not downloaded yet
2026-01-28 20:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3cff01f-d26c-5b0f-9a7c-d335777321b5 with identifier: 1879022
2026-01-28 20:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3cff01f-d26c-5b0f-9a7c-d335777321b5 with identifier: 1879022
2026-01-28 20:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d3cff01f-d26c-5b0f-9a7c-d335777321b5 spider: ayvens.be
2026-01-28 20:07:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d3cff01f-d26c-5b0f-9a7c-d335777321b5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd3cff01f-d26c-5b0f-9a7c-d335777321b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 81163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282933,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306344,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3cff01f-d26c-5b0f-9a7c-d335777321b5/d3cff01f-d26c-5b0f-9a7c-d335777321b5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wx/2cb38ffc8b624f5daa0aac068629c215/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort (EU6)',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort (EU6)',
 'vin': None,
 'year': 2019}
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879022%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [ayvens.be] INFO: Saving data for 1879022: {'created_time': 1769630878.888273, 'last_price_update_time': 1769630878.888283, 'auction_closing_time': 1770192000.0}
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879022') HTTP/1.1" 204 0
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/11.jpg not downloaded yet
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6090>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/2.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edfc90>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/3.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2e350>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/4.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/12.jpg not downloaded yet
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1be10>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/5.jpg saved to cache
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082ed0>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/6.jpg saved to cache
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/13.jpg not downloaded yet
2026-01-28 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:00 [ayvens.be] INFO: Found listing with ID: 1879024
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879024%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [ayvens.be] INFO: Scrape type for 1879024: 1
2026-01-28 20:08:00 [ayvens.be] INFO: Extracting data for car ID: 1879024
2026-01-28 20:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce8dd5e-faab-57f8-b402-a39069ecf46e with identifier: 1879024
2026-01-28 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce8dd5e-faab-57f8-b402-a39069ecf46e with scrape type 1
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/1.jpg not downloaded yet
2026-01-28 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29410>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/7.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/2.jpg not downloaded yet
2026-01-28 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/3.jpg not downloaded yet
2026-01-28 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e162d0>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/9.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3f790>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/8.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/4.jpg not downloaded yet
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/5.jpg not downloaded yet
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61510>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/10.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f639d0>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/11.jpg saved to cache
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0250>
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/12.jpg saved to cache
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/6.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/7.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/8.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/9.jpg not downloaded yet
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ced550>
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252F1cdb6c77f76d4e9ebe698db9c9cabad2%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/13.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d07c406e-73b1-5469-ae5d-162ac0517c45
2026-01-28 20:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d07c406e-73b1-5469-ae5d-162ac0517c45, skipping ID generation
2026-01-28 20:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07c406e-73b1-5469-ae5d-162ac0517c45 with scrape type 1
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d07c406e-73b1-5469-ae5d-162ac0517c45 from tracking dictionaries
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d07c406e-73b1-5469-ae5d-162ac0517c45 sending to next pipeline
2026-01-28 20:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d07c406e-73b1-5469-ae5d-162ac0517c45, identifier: 1879023
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/10.jpg not downloaded yet
2026-01-28 20:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d07c406e-73b1-5469-ae5d-162ac0517c45 with identifier: 1879023
2026-01-28 20:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d07c406e-73b1-5469-ae5d-162ac0517c45 with identifier: 1879023
2026-01-28 20:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d07c406e-73b1-5469-ae5d-162ac0517c45 with identifier: 1879023 to the API
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.2L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd07c406e-73b1-5469-ae5d-162ac0517c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 45964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301575,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146217,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07c406e-73b1-5469-ae5d-162ac0517c45/d07c406e-73b1-5469-ae5d-162ac0517c45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/1cdb6c77f76d4e9ebe698db9c9cabad2/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.2 PURETECH 110 M LIGHT',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 110 M LIGHT',
 'vin': None,
 'year': 2023}
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879023%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [ayvens.be] INFO: Saving data for 1879023: {'created_time': 1769630883.678026, 'last_price_update_time': 1769630883.678036, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879023') HTTP/1.1" 204 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/11.jpg not downloaded yet
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb4610>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/1.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46750>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/2.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e456d0>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/3.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/12.jpg not downloaded yet
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/13.jpg not downloaded yet
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/14.jpg not downloaded yet
2026-01-28 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:04 [ayvens.be] INFO: Found listing with ID: 1879025
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879025%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [ayvens.be] INFO: Scrape type for 1879025: 1
2026-01-28 20:08:04 [ayvens.be] INFO: Extracting data for car ID: 1879025
2026-01-28 20:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0eda10-6849-55d9-b40a-5857f9183a66 with identifier: 1879025
2026-01-28 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0eda10-6849-55d9-b40a-5857f9183a66 with scrape type 1
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/1.jpg not downloaded yet
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/2.jpg not downloaded yet
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b757d0>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/5.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/3.jpg not downloaded yet
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33cd0>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/4.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2c8d0>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/6.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6850>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/7.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9050>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/8.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2dc10>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/9.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/4.jpg not downloaded yet
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/5.jpg not downloaded yet
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9990>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/10.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/6.jpg not downloaded yet
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/7.jpg not downloaded yet
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22e50>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/13.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6190>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/11.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20210>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/12.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080790>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eu%252F42c8c8fbc8e1476fbf51b046e5154b31%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/14.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fce8dd5e-faab-57f8-b402-a39069ecf46e
2026-01-28 20:08:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fce8dd5e-faab-57f8-b402-a39069ecf46e, skipping ID generation
2026-01-28 20:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce8dd5e-faab-57f8-b402-a39069ecf46e with scrape type 1
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fce8dd5e-faab-57f8-b402-a39069ecf46e from tracking dictionaries
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fce8dd5e-faab-57f8-b402-a39069ecf46e sending to next pipeline
2026-01-28 20:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fce8dd5e-faab-57f8-b402-a39069ecf46e, identifier: 1879024
2026-01-28 20:08:08 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -5 pages/min), scraped 18 items (at 6 items/min)
2026-01-28 20:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fce8dd5e-faab-57f8-b402-a39069ecf46e with identifier: 1879024
2026-01-28 20:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fce8dd5e-faab-57f8-b402-a39069ecf46e with identifier: 1879024
2026-01-28 20:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fce8dd5e-faab-57f8-b402-a39069ecf46e with identifier: 1879024 to the API
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fce8dd5e-faab-57f8-b402-a39069ecf46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 43351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354462,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265146,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206514,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265339,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce8dd5e-faab-57f8-b402-a39069ecf46e/fce8dd5e-faab-57f8-b402-a39069ecf46e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eu/42c8c8fbc8e1476fbf51b046e5154b31/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 118I (100KW)',
 'transmission': 'manual',
 'trim': '1.5 118I (100KW)',
 'vin': None,
 'year': 2024}
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879024%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [ayvens.be] INFO: Saving data for 1879024: {'created_time': 1769630888.785242, 'last_price_update_time': 1769630888.785252, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879024') HTTP/1.1" 204 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/8.jpg not downloaded yet
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/9.jpg not downloaded yet
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/10.jpg not downloaded yet
2026-01-28 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/11.jpg not downloaded yet
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/12.jpg not downloaded yet
2026-01-28 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5a90>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/1.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/13.jpg not downloaded yet
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/14.jpg not downloaded yet
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23610>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/3.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e850>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/2.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4890>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/4.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8eb10>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/5.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/15.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/16.jpg not downloaded yet
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/17.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/18.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/19.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [ayvens.be] INFO: Found listing with ID: 1879026
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879026%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [ayvens.be] INFO: Scrape type for 1879026: 1
2026-01-28 20:08:10 [ayvens.be] INFO: Extracting data for car ID: 1879026
2026-01-28 20:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with identifier: 1879026
2026-01-28 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with scrape type 1
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/1.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/2.jpg not downloaded yet
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/3.jpg not downloaded yet
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3ca50>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/6.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/4.jpg not downloaded yet
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/5.jpg not downloaded yet
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d16a50>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/7.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbd850>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/10.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30250>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/11.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32d10>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/8.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32bd0>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/12.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/6.jpg not downloaded yet
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/7.jpg not downloaded yet
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/8.jpg not downloaded yet
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/9.jpg not downloaded yet
2026-01-28 20:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/10.jpg not downloaded yet
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/11.jpg not downloaded yet
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e17b50>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/13.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/12.jpg not downloaded yet
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceb2d0>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/16.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15790>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/15.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2de50>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/17.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6d810>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/18.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c696d0>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/14.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b90790>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/19.jpg saved to cache
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e17590>
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fc7bb9431ab644b6fa6eb68ff852f6357%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/9.jpg saved to cache
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce0eda10-6849-55d9-b40a-5857f9183a66
2026-01-28 20:08:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce0eda10-6849-55d9-b40a-5857f9183a66, skipping ID generation
2026-01-28 20:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0eda10-6849-55d9-b40a-5857f9183a66 with scrape type 1
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce0eda10-6849-55d9-b40a-5857f9183a66 from tracking dictionaries
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce0eda10-6849-55d9-b40a-5857f9183a66 sending to next pipeline
2026-01-28 20:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ce0eda10-6849-55d9-b40a-5857f9183a66, identifier: 1879025
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/13.jpg not downloaded yet
2026-01-28 20:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ce0eda10-6849-55d9-b40a-5857f9183a66 with identifier: 1879025
2026-01-28 20:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ce0eda10-6849-55d9-b40a-5857f9183a66 with identifier: 1879025
2026-01-28 20:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ce0eda10-6849-55d9-b40a-5857f9183a66 with identifier: 1879025 to the API
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ce0eda10-6849-55d9-b40a-5857f9183a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 95121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642911,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611889,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 767698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 895252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 842383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0eda10-6849-55d9-b40a-5857f9183a66/ce0eda10-6849-55d9-b40a-5857f9183a66_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/c7bb9431ab644b6fa6eb68ff852f6357/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879025%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [ayvens.be] INFO: Saving data for 1879025: {'created_time': 1769630896.195003, 'last_price_update_time': 1769630896.195017, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879025') HTTP/1.1" 204 0
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/14.jpg not downloaded yet
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [ayvens.be] INFO: Found listing with ID: 1879027
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879027%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [ayvens.be] INFO: Scrape type for 1879027: 1
2026-01-28 20:08:16 [ayvens.be] INFO: Extracting data for car ID: 1879027
2026-01-28 20:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de7a5793-d84b-5217-8693-c89e3f24a7dd with identifier: 1879027
2026-01-28 20:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7a5793-d84b-5217-8693-c89e3f24a7dd with scrape type 1
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/1.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/2.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/3.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/4.jpg not downloaded yet
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2e250>
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/3.jpg saved to cache
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c00d90>
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/5.jpg saved to cache
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6f950>
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/6.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/5.jpg not downloaded yet
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/6.jpg not downloaded yet
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c641d0>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/1.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd3d50>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/2.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05190>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/4.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b76a10>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/8.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27fd0>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/7.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/7.jpg not downloaded yet
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/8.jpg not downloaded yet
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e47590>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/12.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/9.jpg not downloaded yet
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/10.jpg not downloaded yet
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91b50>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/9.jpg saved to cache
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48dd0>
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/13.jpg saved to cache
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48d90>
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/10.jpg saved to cache
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4a510>
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/11.jpg saved to cache
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6a790>
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/1.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e17590>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/2.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2c990>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ej%252F4d2c33f66ec34511a36b5a4c8e7daf1e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/14.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8
2026-01-28 20:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8, skipping ID generation
2026-01-28 20:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with scrape type 1
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 from tracking dictionaries
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 sending to next pipeline
2026-01-28 20:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8, identifier: 1879026
2026-01-28 20:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with identifier: 1879026
2026-01-28 20:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with identifier: 1879026
2026-01-28 20:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8 with identifier: 1879026 to the API
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 115384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316963,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261877,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8/bd6755e6-de2a-5af0-95f0-eecdf0fd2dc8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ej/4d2c33f66ec34511a36b5a4c8e7daf1e/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2023}
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879026%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [ayvens.be] INFO: Saving data for 1879026: {'created_time': 1769630901.278225, 'last_price_update_time': 1769630901.278236, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879026') HTTP/1.1" 204 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/11.jpg not downloaded yet
2026-01-28 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54290>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/3.jpg saved to cache
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/12.jpg not downloaded yet
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/13.jpg not downloaded yet
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ea10>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/4.jpg saved to cache
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e3d0>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/6.jpg saved to cache
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/14.jpg not downloaded yet
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33bd0>
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/5.jpg saved to cache
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:22 [ayvens.be] INFO: Found listing with ID: 1879028
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879028%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [ayvens.be] INFO: Scrape type for 1879028: 1
2026-01-28 20:08:22 [ayvens.be] INFO: Extracting data for car ID: 1879028
2026-01-28 20:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with identifier: 1879028
2026-01-28 20:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with scrape type 1
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/1.jpg not downloaded yet
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/2.jpg not downloaded yet
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0d750>
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/7.jpg saved to cache
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22790>
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/8.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87950>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/9.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/3.jpg not downloaded yet
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d21c50>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/11.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57050>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/10.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/4.jpg not downloaded yet
2026-01-28 20:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/5.jpg not downloaded yet
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15890>
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/12.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/6.jpg not downloaded yet
2026-01-28 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/7.jpg not downloaded yet
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6850>
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/13.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5e150>
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ck%252Fd5ac624ce4fb4cf7b2fe65368f19f35d%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/14.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item de7a5793-d84b-5217-8693-c89e3f24a7dd
2026-01-28 20:08:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de7a5793-d84b-5217-8693-c89e3f24a7dd, skipping ID generation
2026-01-28 20:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de7a5793-d84b-5217-8693-c89e3f24a7dd with scrape type 1
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item de7a5793-d84b-5217-8693-c89e3f24a7dd from tracking dictionaries
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de7a5793-d84b-5217-8693-c89e3f24a7dd sending to next pipeline
2026-01-28 20:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: de7a5793-d84b-5217-8693-c89e3f24a7dd, identifier: 1879027
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/8.jpg not downloaded yet
2026-01-28 20:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: de7a5793-d84b-5217-8693-c89e3f24a7dd with identifier: 1879027
2026-01-28 20:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: de7a5793-d84b-5217-8693-c89e3f24a7dd with identifier: 1879027
2026-01-28 20:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: de7a5793-d84b-5217-8693-c89e3f24a7dd with identifier: 1879027 to the API
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'de7a5793-d84b-5217-8693-c89e3f24a7dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 39357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282947,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de7a5793-d84b-5217-8693-c89e3f24a7dd/de7a5793-d84b-5217-8693-c89e3f24a7dd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ck/d5ac624ce4fb4cf7b2fe65368f19f35d/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI 81KW ACTIVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 81KW ACTIVE',
 'vin': None,
 'year': 2022}
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879027%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [ayvens.be] INFO: Saving data for 1879027: {'created_time': 1769630905.476592, 'last_price_update_time': 1769630905.476603, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879027') HTTP/1.1" 204 0
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/9.jpg not downloaded yet
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b306d0>
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/1.jpg saved to cache
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/10.jpg not downloaded yet
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/11.jpg not downloaded yet
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a690>
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/2.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e17d90>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/3.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/12.jpg not downloaded yet
2026-01-28 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08410>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/4.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51f90>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/5.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2c950>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/6.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/13.jpg not downloaded yet
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [ayvens.be] INFO: Found listing with ID: 1879029
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879029%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [ayvens.be] INFO: Scrape type for 1879029: 1
2026-01-28 20:08:27 [ayvens.be] INFO: Extracting data for car ID: 1879029
2026-01-28 20:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5fbce10-42d3-5dd4-9ff4-8c9def14c932 with identifier: 1879029
2026-01-28 20:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932 with scrape type 1
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/1.jpg not downloaded yet
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8ef50>
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/7.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/2.jpg not downloaded yet
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/3.jpg not downloaded yet
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78350>
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/9.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/4.jpg not downloaded yet
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/5.jpg not downloaded yet
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e549d0>
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/8.jpg saved to cache
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efe410>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/10.jpg saved to cache
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/6.jpg not downloaded yet
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e54a90>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/12.jpg saved to cache
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1350>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/11.jpg saved to cache
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/7.jpg not downloaded yet
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/8.jpg not downloaded yet
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/9.jpg not downloaded yet
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/10.jpg not downloaded yet
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/11.jpg not downloaded yet
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/12.jpg not downloaded yet
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/13.jpg not downloaded yet
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7a10>
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F4c22be4549e04f729611d5b877333075%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/13.jpg saved to cache
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011
2026-01-28 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 258c3ac0-cce5-5f3d-a25f-0e062fc28011, skipping ID generation
2026-01-28 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with scrape type 1
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 258c3ac0-cce5-5f3d-a25f-0e062fc28011 from tracking dictionaries
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 258c3ac0-cce5-5f3d-a25f-0e062fc28011 sending to next pipeline
2026-01-28 20:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 258c3ac0-cce5-5f3d-a25f-0e062fc28011, identifier: 1879028
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ebd0>
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/1.jpg saved to cache
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:30 [ayvens.be] INFO: Found listing with ID: 1879030
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879030%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [ayvens.be] INFO: Scrape type for 1879030: 1
2026-01-28 20:08:30 [ayvens.be] INFO: Extracting data for car ID: 1879030
2026-01-28 20:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1465e29c-51be-5aab-b681-69044b2a62b1 with identifier: 1879030
2026-01-28 20:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1465e29c-51be-5aab-b681-69044b2a62b1 with scrape type 1
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/1.jpg not downloaded yet
2026-01-28 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with identifier: 1879028
2026-01-28 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with identifier: 1879028
2026-01-28 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 258c3ac0-cce5-5f3d-a25f-0e062fc28011 with identifier: 1879028 to the API
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '258c3ac0-cce5-5f3d-a25f-0e062fc28011',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 57889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240586,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_258c3ac0-cce5-5f3d-a25f-0e062fc28011/258c3ac0-cce5-5f3d-a25f-0e062fc28011_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376817,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/4c22be4549e04f729611d5b877333075/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO 1.0 TSI',
 'transmission': 'manual',
 'trim': '1.0 TSI',
 'vin': None,
 'year': 2022}
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879028%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [ayvens.be] INFO: Saving data for 1879028: {'created_time': 1769630910.558505, 'last_price_update_time': 1769630910.558514, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879028') HTTP/1.1" 204 0
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6d10>
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/3.jpg saved to cache
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e54b90>
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/4.jpg saved to cache
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53650>
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/2.jpg saved to cache
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/2.jpg not downloaded yet
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/3.jpg not downloaded yet
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3cd50>
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/5.jpg saved to cache
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/4.jpg not downloaded yet
2026-01-28 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d171d0>
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/6.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2dcd0>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/8.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2fad0>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/7.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/5.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/6.jpg not downloaded yet
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5f550>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/9.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c08210>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/10.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75850>
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/11.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1ae50>
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/12.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/7.jpg not downloaded yet
2026-01-28 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6fd0>
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xv%252Fefca1b8bbc7546eb9aa2a56e22650b9f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/13.jpg saved to cache
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932
2026-01-28 20:08:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5fbce10-42d3-5dd4-9ff4-8c9def14c932, skipping ID generation
2026-01-28 20:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932 with scrape type 1
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c5fbce10-42d3-5dd4-9ff4-8c9def14c932 from tracking dictionaries
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5fbce10-42d3-5dd4-9ff4-8c9def14c932 sending to next pipeline
2026-01-28 20:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5fbce10-42d3-5dd4-9ff4-8c9def14c932, identifier: 1879029
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/8.jpg not downloaded yet
2026-01-28 20:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5fbce10-42d3-5dd4-9ff4-8c9def14c932 with identifier: 1879029
2026-01-28 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5fbce10-42d3-5dd4-9ff4-8c9def14c932 with identifier: 1879029
2026-01-28 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149508 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149508
2026-01-28 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c5fbce10-42d3-5dd4-9ff4-8c9def14c932 spider: ayvens.be
2026-01-28 20:08:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c5fbce10-42d3-5dd4-9ff4-8c9def14c932 due to rule: high_mileage_for_country.json, error: 149508 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149508
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c5fbce10-42d3-5dd4-9ff4-8c9def14c932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 149508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364069,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fbce10-42d3-5dd4-9ff4-8c9def14c932/c5fbce10-42d3-5dd4-9ff4-8c9def14c932_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xv/efca1b8bbc7546eb9aa2a56e22650b9f/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-05',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 1.5 TSI ACT Platinum OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Platinum OPF DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879029%27 HTTP/1.1" 200 None
2026-01-28 20:08:34 [ayvens.be] INFO: Saving data for 1879029: {'created_time': 1769630914.544676, 'last_price_update_time': 1769630914.544687, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879029') HTTP/1.1" 204 0
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/9.jpg not downloaded yet
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ee10>
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/1.jpg saved to cache
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e142d0>
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/2.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/10.jpg not downloaded yet
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/11.jpg not downloaded yet
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/12.jpg not downloaded yet
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/13.jpg not downloaded yet
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/14.jpg not downloaded yet
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7a510>
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/3.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8d110>
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/4.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:35 [ayvens.be] INFO: Found listing with ID: 1879031
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879031%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [ayvens.be] INFO: Scrape type for 1879031: 1
2026-01-28 20:08:35 [ayvens.be] INFO: Extracting data for car ID: 1879031
2026-01-28 20:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28456705-b43c-595a-a4f2-3957fa7dc926 with identifier: 1879031
2026-01-28 20:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28456705-b43c-595a-a4f2-3957fa7dc926 with scrape type 1
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/1.jpg not downloaded yet
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc3190>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/5.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f39cd0>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/6.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/2.jpg not downloaded yet
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc9690>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/7.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/3.jpg not downloaded yet
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/4.jpg not downloaded yet
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/5.jpg not downloaded yet
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/6.jpg not downloaded yet
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/7.jpg not downloaded yet
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/8.jpg not downloaded yet
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2b10>
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/10.jpg saved to cache
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/9.jpg not downloaded yet
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/10.jpg not downloaded yet
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/11.jpg not downloaded yet
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51250>
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/13.jpg saved to cache
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/12.jpg not downloaded yet
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/13.jpg not downloaded yet
2026-01-28 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee5310>
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/2.jpg saved to cache
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14950>
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/9.jpg saved to cache
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/14.jpg not downloaded yet
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [ayvens.be] INFO: Found listing with ID: 1879032
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879032%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.be] INFO: Scrape type for 1879032: 1
2026-01-28 20:08:38 [ayvens.be] INFO: Extracting data for car ID: 1879032
2026-01-28 20:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbc0eeb-c5a4-5489-8277-804070b65014 with identifier: 1879032
2026-01-28 20:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbc0eeb-c5a4-5489-8277-804070b65014 with scrape type 1
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/1.jpg not downloaded yet
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/2.jpg not downloaded yet
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20190>
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/3.jpg saved to cache
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4edd0>
2026-01-28 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/11.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce98d0>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/8.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24c10>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/12.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/3.jpg not downloaded yet
2026-01-28 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/4.jpg not downloaded yet
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a51190>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/5.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b190>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/4.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e60c90>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/6.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/5.jpg not downloaded yet
2026-01-28 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/6.jpg not downloaded yet
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e15050>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/7.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0550>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F276da78d443b427da449c87cf114cbaa%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/14.jpg saved to cache
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1465e29c-51be-5aab-b681-69044b2a62b1
2026-01-28 20:08:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1465e29c-51be-5aab-b681-69044b2a62b1, skipping ID generation
2026-01-28 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1465e29c-51be-5aab-b681-69044b2a62b1 with scrape type 1
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1465e29c-51be-5aab-b681-69044b2a62b1 from tracking dictionaries
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1465e29c-51be-5aab-b681-69044b2a62b1 sending to next pipeline
2026-01-28 20:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1465e29c-51be-5aab-b681-69044b2a62b1, identifier: 1879030
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5190>
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/9.jpg saved to cache
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e06810>
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/1.jpg saved to cache
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/7.jpg not downloaded yet
2026-01-28 20:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1465e29c-51be-5aab-b681-69044b2a62b1 with identifier: 1879030
2026-01-28 20:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1465e29c-51be-5aab-b681-69044b2a62b1 with identifier: 1879030
2026-01-28 20:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1465e29c-51be-5aab-b681-69044b2a62b1 with identifier: 1879030 to the API
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '1465e29c-51be-5aab-b681-69044b2a62b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 14371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379504,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326676,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1465e29c-51be-5aab-b681-69044b2a62b1/1465e29c-51be-5aab-b681-69044b2a62b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/276da78d443b427da449c87cf114cbaa/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.6 PHEV 225 E-AUTO8 GT',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 E-AUTO8 GT',
 'vin': None,
 'year': 2021}
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879030%27 HTTP/1.1" 200 None
2026-01-28 20:08:42 [ayvens.be] INFO: Saving data for 1879030: {'created_time': 1769630922.380259, 'last_price_update_time': 1769630922.38027, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879030') HTTP/1.1" 204 0
2026-01-28 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/8.jpg not downloaded yet
2026-01-28 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8c810>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/10.jpg saved to cache
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60550>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/11.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edb450>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/8.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8c890>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/12.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/9.jpg not downloaded yet
2026-01-28 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de55d0>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/13.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5790>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2de%252F0359df78c26b4af0a70aa8f68842c34c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/14.jpg saved to cache
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 28456705-b43c-595a-a4f2-3957fa7dc926
2026-01-28 20:08:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28456705-b43c-595a-a4f2-3957fa7dc926, skipping ID generation
2026-01-28 20:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28456705-b43c-595a-a4f2-3957fa7dc926 with scrape type 1
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 28456705-b43c-595a-a4f2-3957fa7dc926 from tracking dictionaries
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28456705-b43c-595a-a4f2-3957fa7dc926 sending to next pipeline
2026-01-28 20:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28456705-b43c-595a-a4f2-3957fa7dc926, identifier: 1879031
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/10.jpg not downloaded yet
2026-01-28 20:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28456705-b43c-595a-a4f2-3957fa7dc926 with identifier: 1879031
2026-01-28 20:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28456705-b43c-595a-a4f2-3957fa7dc926 with identifier: 1879031
2026-01-28 20:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28456705-b43c-595a-a4f2-3957fa7dc926 with identifier: 1879031 to the API
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '28456705-b43c-595a-a4f2-3957fa7dc926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1-serie',
 'odometer': 43069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327859,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276763,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28456705-b43c-595a-a4f2-3957fa7dc926/28456705-b43c-595a-a4f2-3957fa7dc926_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279091,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2de/0359df78c26b4af0a70aa8f68842c34c/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1-serie 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2023}
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879031%27 HTTP/1.1" 200 None
2026-01-28 20:08:44 [ayvens.be] INFO: Saving data for 1879031: {'created_time': 1769630924.653511, 'last_price_update_time': 1769630924.653521, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879031') HTTP/1.1" 204 0
2026-01-28 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0d90>
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/1.jpg saved to cache
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/11.jpg not downloaded yet
2026-01-28 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8f590>
2026-01-28 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/5.jpg saved to cache
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/12.jpg not downloaded yet
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2b210>
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/3.jpg saved to cache
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/13.jpg not downloaded yet
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcafd0>
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/2.jpg saved to cache
2026-01-28 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98c10>
2026-01-28 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/4.jpg saved to cache
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98510>
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/6.jpg saved to cache
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/14.jpg not downloaded yet
2026-01-28 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:46 [ayvens.be] INFO: Found listing with ID: 1879033
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879033%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.be] INFO: Scrape type for 1879033: 1
2026-01-28 20:08:46 [ayvens.be] INFO: Extracting data for car ID: 1879033
2026-01-28 20:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with identifier: 1879033
2026-01-28 20:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with scrape type 1
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/1.jpg not downloaded yet
2026-01-28 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/2.jpg not downloaded yet
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/3.jpg not downloaded yet
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/4.jpg not downloaded yet
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0a10>
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/7.jpg saved to cache
2026-01-28 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78f10>
2026-01-28 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/8.jpg saved to cache
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efd2d0>
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/9.jpg saved to cache
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/5.jpg not downloaded yet
2026-01-28 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59810>
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/10.jpg saved to cache
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/6.jpg not downloaded yet
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26510>
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/11.jpg saved to cache
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/7.jpg not downloaded yet
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc9810>
2026-01-28 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/12.jpg saved to cache
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/8.jpg not downloaded yet
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eff5d0>
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/13.jpg saved to cache
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/9.jpg not downloaded yet
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a624d0>
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hx%252F0f39f7de79da4e4da652a78c413932d7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/14.jpg saved to cache
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ffbc0eeb-c5a4-5489-8277-804070b65014
2026-01-28 20:08:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffbc0eeb-c5a4-5489-8277-804070b65014, skipping ID generation
2026-01-28 20:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbc0eeb-c5a4-5489-8277-804070b65014 with scrape type 1
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ffbc0eeb-c5a4-5489-8277-804070b65014 from tracking dictionaries
2026-01-28 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffbc0eeb-c5a4-5489-8277-804070b65014 sending to next pipeline
2026-01-28 20:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ffbc0eeb-c5a4-5489-8277-804070b65014, identifier: 1879032
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f298d0>
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/2.jpg saved to cache
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf1a50>
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/1.jpg saved to cache
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/10.jpg not downloaded yet
2026-01-28 20:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ffbc0eeb-c5a4-5489-8277-804070b65014 with identifier: 1879032
2026-01-28 20:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ffbc0eeb-c5a4-5489-8277-804070b65014 with identifier: 1879032
2026-01-28 20:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 8 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    8
2026-01-28 20:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: LOW_MILEAGE_FOR_COUNTRY failed for item: ffbc0eeb-c5a4-5489-8277-804070b65014 spider: ayvens.be
2026-01-28 20:08:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ffbc0eeb-c5a4-5489-8277-804070b65014 due to rule: low_mileage_for_country.json, error: 8 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    8
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': 'ffbc0eeb-c5a4-5489-8277-804070b65014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX1',
 'odometer': 8,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375497,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264216,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffbc0eeb-c5a4-5489-8277-804070b65014/ffbc0eeb-c5a4-5489-8277-804070b65014_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hx/0f39f7de79da4e4da652a78c413932d7/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX1 BEV 67KWH EDRIVE20 150KW M EDITION',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EDRIVE20 150KW M EDITION',
 'vin': None,
 'year': 2025}
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879032%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.be] INFO: Saving data for 1879032: {'created_time': 1769630929.936692, 'last_price_update_time': 1769630929.9367, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879032') HTTP/1.1" 204 0
2026-01-28 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/11.jpg not downloaded yet
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0f90>
2026-01-28 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/3.jpg saved to cache
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2dd0>
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/4.jpg saved to cache
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3bcd0>
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/5.jpg saved to cache
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/12.jpg not downloaded yet
2026-01-28 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/13.jpg not downloaded yet
2026-01-28 20:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f995d0>
2026-01-28 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/6.jpg saved to cache
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/14.jpg not downloaded yet
2026-01-28 20:08:51 [ayvens.be] INFO: Found listing with ID: 1879034
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879034%27 HTTP/1.1" 200 None
2026-01-28 20:08:51 [ayvens.be] INFO: Scrape type for 1879034: 1
2026-01-28 20:08:51 [ayvens.be] INFO: Extracting data for car ID: 1879034
2026-01-28 20:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with identifier: 1879034
2026-01-28 20:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with scrape type 1
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/1.jpg not downloaded yet
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87a10>
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/7.jpg saved to cache
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30811d0>
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/9.jpg saved to cache
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/2.jpg not downloaded yet
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8c210>
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/8.jpg saved to cache
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/3.jpg not downloaded yet
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/4.jpg not downloaded yet
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/5.jpg not downloaded yet
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/6.jpg not downloaded yet
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/7.jpg not downloaded yet
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/8.jpg not downloaded yet
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/9.jpg not downloaded yet
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e61150>
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/11.jpg saved to cache
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/10.jpg not downloaded yet
2026-01-28 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/11.jpg not downloaded yet
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceae90>
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/13.jpg saved to cache
2026-01-28 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36110>
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/12.jpg saved to cache
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37dd0>
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/10.jpg saved to cache
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52490>
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bl%252Fc545016f3a3743e496c745617d39415f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/14.jpg saved to cache
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07
2026-01-28 20:08:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08130536-4bb2-5d73-9a87-fa3fbb70cf07, skipping ID generation
2026-01-28 20:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with scrape type 1
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08130536-4bb2-5d73-9a87-fa3fbb70cf07 from tracking dictionaries
2026-01-28 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08130536-4bb2-5d73-9a87-fa3fbb70cf07 sending to next pipeline
2026-01-28 20:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 08130536-4bb2-5d73-9a87-fa3fbb70cf07, identifier: 1879033
2026-01-28 20:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with identifier: 1879033
2026-01-28 20:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with identifier: 1879033
2026-01-28 20:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 08130536-4bb2-5d73-9a87-fa3fbb70cf07 with identifier: 1879033 to the API
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '08130536-4bb2-5d73-9a87-fa3fbb70cf07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB COMBI',
 'odometer': 91183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294135,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08130536-4bb2-5d73-9a87-fa3fbb70cf07/08130536-4bb2-5d73-9a87-fa3fbb70cf07_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bl/c545016f3a3743e496c745617d39415f/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB COMBI 2.0 CRTDI 90KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '2.0 CRTDI 90KW DSG7 CLEVER',
 'vin': None,
 'year': 2022}
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879033%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [ayvens.be] INFO: Saving data for 1879033: {'created_time': 1769630934.140877, 'last_price_update_time': 1769630934.140888, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879033') HTTP/1.1" 204 0
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/12.jpg not downloaded yet
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/13.jpg not downloaded yet
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec8290>
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/1.jpg saved to cache
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/14.jpg not downloaded yet
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [ayvens.be] INFO: Found listing with ID: 1879035
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879035%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [ayvens.be] INFO: Scrape type for 1879035: 1
2026-01-28 20:08:54 [ayvens.be] INFO: Extracting data for car ID: 1879035
2026-01-28 20:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with identifier: 1879035
2026-01-28 20:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with scrape type 1
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/1.jpg not downloaded yet
2026-01-28 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3cf50>
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/5.jpg saved to cache
2026-01-28 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3c090>
2026-01-28 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/2.jpg saved to cache
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e62a90>
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/3.jpg saved to cache
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d516d0>
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/4.jpg saved to cache
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3ecd0>
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/6.jpg saved to cache
2026-01-28 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7a10>
2026-01-28 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/7.jpg saved to cache
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/2.jpg not downloaded yet
2026-01-28 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/3.jpg not downloaded yet
2026-01-28 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51bd0>
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/9.jpg saved to cache
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36e10>
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/8.jpg saved to cache
2026-01-28 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6b1d0>
2026-01-28 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/10.jpg saved to cache
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/4.jpg not downloaded yet
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/5.jpg not downloaded yet
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84d50>
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/11.jpg saved to cache
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded550>
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/12.jpg saved to cache
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de3390>
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/13.jpg saved to cache
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/6.jpg not downloaded yet
2026-01-28 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/7.jpg not downloaded yet
2026-01-28 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/8.jpg not downloaded yet
2026-01-28 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/9.jpg not downloaded yet
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/10.jpg not downloaded yet
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/11.jpg not downloaded yet
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/12.jpg not downloaded yet
2026-01-28 20:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/13.jpg not downloaded yet
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2f390>
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F2e02a1b876e04e99bcad54d4b1dea161%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/14.jpg saved to cache
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd
2026-01-28 20:08:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd, skipping ID generation
2026-01-28 20:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with scrape type 1
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd from tracking dictionaries
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd sending to next pipeline
2026-01-28 20:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd, identifier: 1879034
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/14.jpg not downloaded yet
2026-01-28 20:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with identifier: 1879034
2026-01-28 20:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with identifier: 1879034
2026-01-28 20:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2cbbd4f2-ba8b-57df-a216-62ac98cef7cd with identifier: 1879034 to the API
2026-01-28 20:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '2cbbd4f2-ba8b-57df-a216-62ac98cef7cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 100035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335476,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351226,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cbbd4f2-ba8b-57df-a216-62ac98cef7cd/2cbbd4f2-ba8b-57df-a216-62ac98cef7cd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/2e02a1b876e04e99bcad54d4b1dea161/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.0 TSI Life OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Life OPF',
 'vin': None,
 'year': 2022}
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879034%27 HTTP/1.1" 200 None
2026-01-28 20:08:59 [ayvens.be] INFO: Saving data for 1879034: {'created_time': 1769630939.920636, 'last_price_update_time': 1769630939.920646, 'auction_closing_time': 1770192000.0}
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879034') HTTP/1.1" 204 0
2026-01-28 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:59 [ayvens.be] INFO: Found listing with ID: 1879036
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879036%27 HTTP/1.1" 200 None
2026-01-28 20:08:59 [ayvens.be] INFO: Scrape type for 1879036: 1
2026-01-28 20:08:59 [ayvens.be] INFO: Extracting data for car ID: 1879036
2026-01-28 20:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecdb6269-9d45-53fd-b852-50a7c416d436 with identifier: 1879036
2026-01-28 20:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecdb6269-9d45-53fd-b852-50a7c416d436 with scrape type 1
2026-01-28 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/1.jpg not downloaded yet
2026-01-28 20:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee5810>
2026-01-28 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/1.jpg saved to cache
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5710>
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/2.jpg saved to cache
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8310>
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/3.jpg saved to cache
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2cad0>
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/4.jpg saved to cache
2026-01-28 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/2.jpg not downloaded yet
2026-01-28 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/3.jpg not downloaded yet
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e63ad0>
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/6.jpg saved to cache
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/4.jpg not downloaded yet
2026-01-28 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/5.jpg not downloaded yet
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1b890>
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/7.jpg saved to cache
2026-01-28 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27710>
2026-01-28 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/5.jpg saved to cache
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f49c50>
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/11.jpg saved to cache
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42590>
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/9.jpg saved to cache
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58910>
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/8.jpg saved to cache
2026-01-28 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c450d0>
2026-01-28 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/10.jpg saved to cache
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/6.jpg not downloaded yet
2026-01-28 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edae50>
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/12.jpg saved to cache
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de2750>
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/13.jpg saved to cache
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/7.jpg not downloaded yet
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/8.jpg not downloaded yet
2026-01-28 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b76350>
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dc%252F986b5925f117440b9683f49c9383f33e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/14.jpg saved to cache
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd
2026-01-28 20:09:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd, skipping ID generation
2026-01-28 20:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with scrape type 1
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd from tracking dictionaries
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc7580ce-dadb-5985-aa5c-9d27ebb7afdd sending to next pipeline
2026-01-28 20:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd, identifier: 1879035
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/9.jpg not downloaded yet
2026-01-28 20:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with identifier: 1879035
2026-01-28 20:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with identifier: 1879035
2026-01-28 20:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: cc7580ce-dadb-5985-aa5c-9d27ebb7afdd with identifier: 1879035 to the API
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': 'cc7580ce-dadb-5985-aa5c-9d27ebb7afdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 34482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 309180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227012,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 427765,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc7580ce-dadb-5985-aa5c-9d27ebb7afdd/cc7580ce-dadb-5985-aa5c-9d27ebb7afdd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dc/986b5925f117440b9683f49c9383f33e/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2023}
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879035%27 HTTP/1.1" 200 None
2026-01-28 20:09:04 [ayvens.be] INFO: Saving data for 1879035: {'created_time': 1769630944.603538, 'last_price_update_time': 1769630944.603548, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879035') HTTP/1.1" 204 0
2026-01-28 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/10.jpg not downloaded yet
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4ca90>
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/1.jpg saved to cache
2026-01-28 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df5150>
2026-01-28 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/2.jpg saved to cache
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df4b10>
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/3.jpg saved to cache
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/11.jpg not downloaded yet
2026-01-28 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/12.jpg not downloaded yet
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78790>
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/4.jpg saved to cache
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/13.jpg not downloaded yet
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36c10>
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/6.jpg saved to cache
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd19d0>
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/5.jpg saved to cache
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1c390>
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/7.jpg saved to cache
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:06 [ayvens.be] INFO: Found listing with ID: 1879037
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879037%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [ayvens.be] INFO: Scrape type for 1879037: 1
2026-01-28 20:09:06 [ayvens.be] INFO: Extracting data for car ID: 1879037
2026-01-28 20:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8390cbd-113c-56e2-af23-992b6fa2a9c8 with identifier: 1879037
2026-01-28 20:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8390cbd-113c-56e2-af23-992b6fa2a9c8 with scrape type 1
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/1.jpg not downloaded yet
2026-01-28 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/2.jpg not downloaded yet
2026-01-28 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/3.jpg not downloaded yet
2026-01-28 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/4.jpg not downloaded yet
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/5.jpg not downloaded yet
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/6.jpg not downloaded yet
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd1790>
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/8.jpg saved to cache
2026-01-28 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/7.jpg not downloaded yet
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/8.jpg not downloaded yet
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e60450>
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/9.jpg saved to cache
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb57d0>
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/10.jpg saved to cache
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2710>
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/11.jpg saved to cache
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 1 pages/min), scraped 28 items (at 10 items/min)
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/9.jpg not downloaded yet
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/10.jpg not downloaded yet
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/11.jpg not downloaded yet
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/12.jpg not downloaded yet
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/13.jpg not downloaded yet
2026-01-28 20:09:07 [ayvens.be] INFO: Found listing with ID: 1879038
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879038%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [ayvens.be] INFO: Scrape type for 1879038: 1
2026-01-28 20:09:07 [ayvens.be] INFO: Extracting data for car ID: 1879038
2026-01-28 20:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabbb0f1-6de7-5641-8613-2fc59656af90 with identifier: 1879038
2026-01-28 20:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabbb0f1-6de7-5641-8613-2fc59656af90 with scrape type 1
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/1.jpg not downloaded yet
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/2.jpg not downloaded yet
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e56d10>
2026-01-28 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/13.jpg saved to cache
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6fd0>
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hh%252F98857729af104c22a9a71abc7354f30b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/12.jpg saved to cache
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ecdb6269-9d45-53fd-b852-50a7c416d436
2026-01-28 20:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecdb6269-9d45-53fd-b852-50a7c416d436, skipping ID generation
2026-01-28 20:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecdb6269-9d45-53fd-b852-50a7c416d436 with scrape type 1
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ecdb6269-9d45-53fd-b852-50a7c416d436 from tracking dictionaries
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecdb6269-9d45-53fd-b852-50a7c416d436 sending to next pipeline
2026-01-28 20:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ecdb6269-9d45-53fd-b852-50a7c416d436, identifier: 1879036
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/3.jpg not downloaded yet
2026-01-28 20:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ecdb6269-9d45-53fd-b852-50a7c416d436 with identifier: 1879036
2026-01-28 20:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ecdb6269-9d45-53fd-b852-50a7c416d436 with identifier: 1879036
2026-01-28 20:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ecdb6269-9d45-53fd-b852-50a7c416d436 with identifier: 1879036 to the API
2026-01-28 20:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ecdb6269-9d45-53fd-b852-50a7c416d436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 6507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349466,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 355647,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235810,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242959,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecdb6269-9d45-53fd-b852-50a7c416d436/ecdb6269-9d45-53fd-b852-50a7c416d436_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hh/98857729af104c22a9a71abc7354f30b/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 HYBRID 136 E-DCS6 GT',
 'transmission': 'automatic',
 'trim': '1.2 HYBRID 136 E-DCS6 GT',
 'vin': None,
 'year': 2025}
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879036%27 HTTP/1.1" 200 None
2026-01-28 20:09:09 [ayvens.be] INFO: Saving data for 1879036: {'created_time': 1769630949.199381, 'last_price_update_time': 1769630949.199391, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879036') HTTP/1.1" 204 0
2026-01-28 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/4.jpg not downloaded yet
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9090>
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/1.jpg saved to cache
2026-01-28 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49d90>
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/2.jpg saved to cache
2026-01-28 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8f50>
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/6.jpg saved to cache
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c98490>
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/3.jpg saved to cache
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4b110>
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/4.jpg saved to cache
2026-01-28 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27190>
2026-01-28 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/5.jpg saved to cache
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/5.jpg not downloaded yet
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/6.jpg not downloaded yet
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d21cd0>
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/9.jpg saved to cache
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/7.jpg not downloaded yet
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/8.jpg not downloaded yet
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cade90>
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/10.jpg saved to cache
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0cc90>
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/7.jpg saved to cache
2026-01-28 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90510>
2026-01-28 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/8.jpg saved to cache
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/9.jpg not downloaded yet
2026-01-28 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccef90>
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/12.jpg saved to cache
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f17850>
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/11.jpg saved to cache
2026-01-28 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2190>
2026-01-28 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2hc%252F8daec19f738d47edbf272abfd3e4f3fd%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/13.jpg saved to cache
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b8390cbd-113c-56e2-af23-992b6fa2a9c8
2026-01-28 20:09:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8390cbd-113c-56e2-af23-992b6fa2a9c8, skipping ID generation
2026-01-28 20:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8390cbd-113c-56e2-af23-992b6fa2a9c8 with scrape type 1
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8390cbd-113c-56e2-af23-992b6fa2a9c8 from tracking dictionaries
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8390cbd-113c-56e2-af23-992b6fa2a9c8 sending to next pipeline
2026-01-28 20:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8390cbd-113c-56e2-af23-992b6fa2a9c8, identifier: 1879037
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e8d0>
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/1.jpg saved to cache
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/10.jpg not downloaded yet
2026-01-28 20:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8390cbd-113c-56e2-af23-992b6fa2a9c8 with identifier: 1879037
2026-01-28 20:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8390cbd-113c-56e2-af23-992b6fa2a9c8 with identifier: 1879037
2026-01-28 20:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 3426 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    3426
2026-01-28 20:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: LOW_MILEAGE_FOR_COUNTRY failed for item: b8390cbd-113c-56e2-af23-992b6fa2a9c8 spider: ayvens.be
2026-01-28 20:09:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b8390cbd-113c-56e2-af23-992b6fa2a9c8 due to rule: low_mileage_for_country.json, error: 3426 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    3426
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b8390cbd-113c-56e2-af23-992b6fa2a9c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 3426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539491,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430029,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350767,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8390cbd-113c-56e2-af23-992b6fa2a9c8/b8390cbd-113c-56e2-af23-992b6fa2a9c8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2hc/8daec19f738d47edbf272abfd3e4f3fd/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 GDI PHEV DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV DCT BUSINESS LINE',
 'vin': None,
 'year': 2025}
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879037%27 HTTP/1.1" 200 None
2026-01-28 20:09:13 [ayvens.be] INFO: Saving data for 1879037: {'created_time': 1769630953.853162, 'last_price_update_time': 1769630953.853171, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879037') HTTP/1.1" 204 0
2026-01-28 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/11.jpg not downloaded yet
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbd910>
2026-01-28 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/2.jpg saved to cache
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6590>
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/3.jpg saved to cache
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/12.jpg not downloaded yet
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e21790>
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/4.jpg saved to cache
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ee90>
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/6.jpg saved to cache
2026-01-28 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/13.jpg not downloaded yet
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e47410>
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/5.jpg saved to cache
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [ayvens.be] INFO: Found listing with ID: 1879039
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879039%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [ayvens.be] INFO: Scrape type for 1879039: 1
2026-01-28 20:09:15 [ayvens.be] INFO: Extracting data for car ID: 1879039
2026-01-28 20:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with identifier: 1879039
2026-01-28 20:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with scrape type 1
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/1.jpg not downloaded yet
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/2.jpg not downloaded yet
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e550>
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/9.jpg saved to cache
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/3.jpg not downloaded yet
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/4.jpg not downloaded yet
2026-01-28 20:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c497d0>
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/7.jpg saved to cache
2026-01-28 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07fd0>
2026-01-28 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/8.jpg saved to cache
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/5.jpg not downloaded yet
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/6.jpg not downloaded yet
2026-01-28 20:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74810>
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/10.jpg saved to cache
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5ccd0>
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/11.jpg saved to cache
2026-01-28 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e390>
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/12.jpg saved to cache
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/7.jpg not downloaded yet
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/8.jpg not downloaded yet
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84f90>
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gj%252F2597d20f9b2644a9b59a6bf3eac11cb7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/13.jpg saved to cache
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item eabbb0f1-6de7-5641-8613-2fc59656af90
2026-01-28 20:09:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eabbb0f1-6de7-5641-8613-2fc59656af90, skipping ID generation
2026-01-28 20:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabbb0f1-6de7-5641-8613-2fc59656af90 with scrape type 1
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eabbb0f1-6de7-5641-8613-2fc59656af90 from tracking dictionaries
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eabbb0f1-6de7-5641-8613-2fc59656af90 sending to next pipeline
2026-01-28 20:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eabbb0f1-6de7-5641-8613-2fc59656af90, identifier: 1879038
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/9.jpg not downloaded yet
2026-01-28 20:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eabbb0f1-6de7-5641-8613-2fc59656af90 with identifier: 1879038
2026-01-28 20:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eabbb0f1-6de7-5641-8613-2fc59656af90 with identifier: 1879038
2026-01-28 20:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eabbb0f1-6de7-5641-8613-2fc59656af90 with identifier: 1879038 to the API
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eabbb0f1-6de7-5641-8613-2fc59656af90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 32240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eabbb0f1-6de7-5641-8613-2fc59656af90/eabbb0f1-6de7-5641-8613-2fc59656af90_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gj/2597d20f9b2644a9b59a6bf3eac11cb7/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE30E PHEV (240KW) 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE30E PHEV (240KW) 4WD AUTO',
 'vin': None,
 'year': 2025}
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879038%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [ayvens.be] INFO: Saving data for 1879038: {'created_time': 1769630958.035551, 'last_price_update_time': 1769630958.035564, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879038') HTTP/1.1" 204 0
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/10.jpg not downloaded yet
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/11.jpg not downloaded yet
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/12.jpg not downloaded yet
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/13.jpg not downloaded yet
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/14.jpg not downloaded yet
2026-01-28 20:09:18 [ayvens.be] INFO: Found listing with ID: 1879040
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879040%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [ayvens.be] INFO: Scrape type for 1879040: 1
2026-01-28 20:09:18 [ayvens.be] INFO: Extracting data for car ID: 1879040
2026-01-28 20:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db9480b5-4ef4-5aba-895f-15d2c73fb1be with identifier: 1879040
2026-01-28 20:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db9480b5-4ef4-5aba-895f-15d2c73fb1be with scrape type 1
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/1.jpg not downloaded yet
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1190>
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/2.jpg saved to cache
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e14690>
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/1.jpg saved to cache
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/2.jpg not downloaded yet
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29210>
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/3.jpg saved to cache
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb98d0>
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/4.jpg saved to cache
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/3.jpg not downloaded yet
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e1d0>
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/6.jpg saved to cache
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2f050>
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/5.jpg saved to cache
2026-01-28 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9ad0>
2026-01-28 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/7.jpg saved to cache
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/4.jpg not downloaded yet
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/5.jpg not downloaded yet
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/6.jpg not downloaded yet
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/7.jpg not downloaded yet
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/8.jpg not downloaded yet
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/9.jpg not downloaded yet
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/10.jpg not downloaded yet
2026-01-28 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/11.jpg not downloaded yet
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5f3d0>
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/9.jpg saved to cache
2026-01-28 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3fed0>
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/8.jpg saved to cache
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/12.jpg not downloaded yet
2026-01-28 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/13.jpg not downloaded yet
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51d50>
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/10.jpg saved to cache
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de0690>
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/12.jpg saved to cache
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42150>
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/13.jpg saved to cache
2026-01-28 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42150>
2026-01-28 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/11.jpg saved to cache
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40950>
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2av%252F638edcc58ca745868660ee83c96c923f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/14.jpg saved to cache
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc
2026-01-28 20:09:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc, skipping ID generation
2026-01-28 20:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with scrape type 1
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc from tracking dictionaries
2026-01-28 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d0d947d-a736-5cc7-87dc-7a77aec22dfc sending to next pipeline
2026-01-28 20:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc, identifier: 1879039
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed3b50>
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/1.jpg saved to cache
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d95e90>
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/3.jpg saved to cache
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with identifier: 1879039
2026-01-28 20:09:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with identifier: 1879039
2026-01-28 20:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9d0d947d-a736-5cc7-87dc-7a77aec22dfc with identifier: 1879039 to the API
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'SAPHIRSCHWARZ METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '9d0d947d-a736-5cc7-87dc-7a77aec22dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 ONLY FOR BELGIAN BUYERS',
 'odometer': 40098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 350179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387066,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 421540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d0d947d-a736-5cc7-87dc-7a77aec22dfc/9d0d947d-a736-5cc7-87dc-7a77aec22dfc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2av/638edcc58ca745868660ee83c96c923f/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 ONLY FOR BELGIAN BUYERS 1.5 XDRIVE25E (162KW) ONLY FOR '
          'BELGIAN BUYERS',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW) ONLY FOR BELGIAN BUYERS',
 'vin': None,
 'year': 2021}
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879039%27 HTTP/1.1" 200 None
2026-01-28 20:09:23 [ayvens.be] INFO: Saving data for 1879039: {'created_time': 1769630963.672605, 'last_price_update_time': 1769630963.672614, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879039') HTTP/1.1" 204 0
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [ayvens.be] INFO: Found listing with ID: 1879041
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879041%27 HTTP/1.1" 200 None
2026-01-28 20:09:23 [ayvens.be] INFO: Scrape type for 1879041: 1
2026-01-28 20:09:23 [ayvens.be] INFO: Extracting data for car ID: 1879041
2026-01-28 20:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77cab732-a91d-501f-bb51-c50d70dbdfa6 with identifier: 1879041
2026-01-28 20:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77cab732-a91d-501f-bb51-c50d70dbdfa6 with scrape type 1
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/1.jpg not downloaded yet
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/2.jpg not downloaded yet
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcac90>
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/2.jpg saved to cache
2026-01-28 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0490>
2026-01-28 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/5.jpg saved to cache
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/3.jpg not downloaded yet
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/4.jpg not downloaded yet
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4510>
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/9.jpg saved to cache
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5af10>
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/7.jpg saved to cache
2026-01-28 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c66610>
2026-01-28 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/4.jpg saved to cache
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4c750>
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/10.jpg saved to cache
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53cd0>
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/6.jpg saved to cache
2026-01-28 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec7890>
2026-01-28 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/8.jpg saved to cache
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/5.jpg not downloaded yet
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee4d90>
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/11.jpg saved to cache
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/6.jpg not downloaded yet
2026-01-28 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/7.jpg not downloaded yet
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec78d0>
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/12.jpg saved to cache
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/8.jpg not downloaded yet
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccfa90>
2026-01-28 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fef12197fa6414937ae9aa28b978dafb3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/13.jpg saved to cache
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db9480b5-4ef4-5aba-895f-15d2c73fb1be
2026-01-28 20:09:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db9480b5-4ef4-5aba-895f-15d2c73fb1be, skipping ID generation
2026-01-28 20:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db9480b5-4ef4-5aba-895f-15d2c73fb1be with scrape type 1
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db9480b5-4ef4-5aba-895f-15d2c73fb1be from tracking dictionaries
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db9480b5-4ef4-5aba-895f-15d2c73fb1be sending to next pipeline
2026-01-28 20:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: db9480b5-4ef4-5aba-895f-15d2c73fb1be, identifier: 1879040
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27050>
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/2.jpg saved to cache
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b41e90>
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/1.jpg saved to cache
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/9.jpg not downloaded yet
2026-01-28 20:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: db9480b5-4ef4-5aba-895f-15d2c73fb1be with identifier: 1879040
2026-01-28 20:09:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: db9480b5-4ef4-5aba-895f-15d2c73fb1be with identifier: 1879040
2026-01-28 20:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'interstar' containing 'interstar'
2026-01-28 20:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: db9480b5-4ef4-5aba-895f-15d2c73fb1be spider: ayvens.be
2026-01-28 20:09:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: db9480b5-4ef4-5aba-895f-15d2c73fb1be due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'interstar' containing 'interstar'
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MINERAL WHITE',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'db9480b5-4ef4-5aba-895f-15d2c73fb1be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'INTERSTAR',
 'odometer': 69241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 310131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284853,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270708,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204764,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db9480b5-4ef4-5aba-895f-15d2c73fb1be/db9480b5-4ef4-5aba-895f-15d2c73fb1be_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/ef12197fa6414937ae9aa28b978dafb3/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN INTERSTAR 2.3 DCI 150 L3H2 3.5T N-CONNECTA',
 'transmission': 'manual',
 'trim': '2.3 DCI 150 L3H2 3.5T N-CONNECTA',
 'vin': None,
 'year': 2022}
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879040%27 HTTP/1.1" 200 None
2026-01-28 20:09:28 [ayvens.be] INFO: Saving data for 1879040: {'created_time': 1769630968.196621, 'last_price_update_time': 1769630968.19663, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879040') HTTP/1.1" 204 0
2026-01-28 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/10.jpg not downloaded yet
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a450>
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/3.jpg saved to cache
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/11.jpg not downloaded yet
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab550>
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/5.jpg saved to cache
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cccd10>
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/4.jpg saved to cache
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/12.jpg not downloaded yet
2026-01-28 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/13.jpg not downloaded yet
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24cd0>
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/6.jpg saved to cache
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/14.jpg not downloaded yet
2026-01-28 20:09:29 [ayvens.be] INFO: Found listing with ID: 1879042
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879042%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [ayvens.be] INFO: Scrape type for 1879042: 1
2026-01-28 20:09:29 [ayvens.be] INFO: Extracting data for car ID: 1879042
2026-01-28 20:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0240dc07-a67f-5bcf-a504-46b8b933c87e with identifier: 1879042
2026-01-28 20:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0240dc07-a67f-5bcf-a504-46b8b933c87e with scrape type 1
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/1.jpg not downloaded yet
2026-01-28 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecfc90>
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/7.jpg saved to cache
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbe050>
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/8.jpg saved to cache
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/2.jpg not downloaded yet
2026-01-28 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/3.jpg not downloaded yet
2026-01-28 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b260d0>
2026-01-28 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/9.jpg saved to cache
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25410>
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/11.jpg saved to cache
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/4.jpg not downloaded yet
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/5.jpg not downloaded yet
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25bd0>
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/10.jpg saved to cache
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99a90>
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/12.jpg saved to cache
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/6.jpg not downloaded yet
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/7.jpg not downloaded yet
2026-01-28 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e053d0>
2026-01-28 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/13.jpg saved to cache
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/8.jpg not downloaded yet
2026-01-28 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/9.jpg not downloaded yet
2026-01-28 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f045d0>
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bd%252F481448737e0d40019550863991ae1bfa%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/14.jpg saved to cache
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 77cab732-a91d-501f-bb51-c50d70dbdfa6
2026-01-28 20:09:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77cab732-a91d-501f-bb51-c50d70dbdfa6, skipping ID generation
2026-01-28 20:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77cab732-a91d-501f-bb51-c50d70dbdfa6 with scrape type 1
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 77cab732-a91d-501f-bb51-c50d70dbdfa6 from tracking dictionaries
2026-01-28 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77cab732-a91d-501f-bb51-c50d70dbdfa6 sending to next pipeline
2026-01-28 20:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 77cab732-a91d-501f-bb51-c50d70dbdfa6, identifier: 1879041
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e167d0>
2026-01-28 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/1.jpg saved to cache
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/10.jpg not downloaded yet
2026-01-28 20:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 77cab732-a91d-501f-bb51-c50d70dbdfa6 with identifier: 1879041
2026-01-28 20:09:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 77cab732-a91d-501f-bb51-c50d70dbdfa6 with identifier: 1879041
2026-01-28 20:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350l fou lwb hhr ds' containing 'transit'
2026-01-28 20:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 77cab732-a91d-501f-bb51-c50d70dbdfa6 spider: ayvens.be
2026-01-28 20:09:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 77cab732-a91d-501f-bb51-c50d70dbdfa6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350l fou lwb hhr ds' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'color': 'KLEUR RAL',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '77cab732-a91d-501f-bb51-c50d70dbdfa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350L FOU LWB HHR DS',
 'odometer': 102786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268043,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238246,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257523,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77cab732-a91d-501f-bb51-c50d70dbdfa6/77cab732-a91d-501f-bb51-c50d70dbdfa6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200353,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bd/481448737e0d40019550863991ae1bfa/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350L FOU LWB HHR DS 2.0 TDCi L3H3 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L3H3 Trend',
 'vin': None,
 'year': 2021}
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879041%27 HTTP/1.1" 200 None
2026-01-28 20:09:32 [ayvens.be] INFO: Saving data for 1879041: {'created_time': 1769630972.311149, 'last_price_update_time': 1769630972.311158, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879041') HTTP/1.1" 204 0
2026-01-28 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/11.jpg not downloaded yet
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec5b10>
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/2.jpg saved to cache
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9a950>
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/3.jpg saved to cache
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/12.jpg not downloaded yet
2026-01-28 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/13.jpg not downloaded yet
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36050>
2026-01-28 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/4.jpg saved to cache
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b050>
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/5.jpg saved to cache
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/14.jpg not downloaded yet
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecf650>
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/6.jpg saved to cache
2026-01-28 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b41e50>
2026-01-28 20:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/7.jpg saved to cache
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:34 [ayvens.be] INFO: Found listing with ID: 1879043
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879043%27 HTTP/1.1" 200 None
2026-01-28 20:09:34 [ayvens.be] INFO: Scrape type for 1879043: 1
2026-01-28 20:09:34 [ayvens.be] INFO: Extracting data for car ID: 1879043
2026-01-28 20:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5784ffd9-552b-5725-9467-19e6a75a898c with identifier: 1879043
2026-01-28 20:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5784ffd9-552b-5725-9467-19e6a75a898c with scrape type 1
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/1.jpg not downloaded yet
2026-01-28 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/2.jpg not downloaded yet
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8450>
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/8.jpg saved to cache
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/3.jpg not downloaded yet
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50550>
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/9.jpg saved to cache
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1a6d0>
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/11.jpg saved to cache
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/4.jpg not downloaded yet
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/5.jpg not downloaded yet
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37d10>
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/10.jpg saved to cache
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/6.jpg not downloaded yet
2026-01-28 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/7.jpg not downloaded yet
2026-01-28 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/8.jpg not downloaded yet
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/9.jpg not downloaded yet
2026-01-28 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/10.jpg not downloaded yet
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/11.jpg not downloaded yet
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/12.jpg not downloaded yet
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8e50>
2026-01-28 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/12.jpg saved to cache
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1d50>
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/14.jpg saved to cache
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dea450>
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252Fdeaa1737e83a4d9ebcfec18dd05f3de3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/13.jpg saved to cache
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0240dc07-a67f-5bcf-a504-46b8b933c87e
2026-01-28 20:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0240dc07-a67f-5bcf-a504-46b8b933c87e, skipping ID generation
2026-01-28 20:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0240dc07-a67f-5bcf-a504-46b8b933c87e with scrape type 1
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0240dc07-a67f-5bcf-a504-46b8b933c87e from tracking dictionaries
2026-01-28 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0240dc07-a67f-5bcf-a504-46b8b933c87e sending to next pipeline
2026-01-28 20:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0240dc07-a67f-5bcf-a504-46b8b933c87e, identifier: 1879042
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78c50>
2026-01-28 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/1.jpg saved to cache
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbdb50>
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/2.jpg saved to cache
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/13.jpg not downloaded yet
2026-01-28 20:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0240dc07-a67f-5bcf-a504-46b8b933c87e with identifier: 1879042
2026-01-28 20:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0240dc07-a67f-5bcf-a504-46b8b933c87e with identifier: 1879042
2026-01-28 20:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0240dc07-a67f-5bcf-a504-46b8b933c87e with identifier: 1879042 to the API
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'WIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '0240dc07-a67f-5bcf-a504-46b8b933c87e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 70010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268288,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401103,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527971,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0240dc07-a67f-5bcf-a504-46b8b933c87e/0240dc07-a67f-5bcf-a504-46b8b933c87e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372182,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/deaa1737e83a4d9ebcfec18dd05f3de3/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160',
 'transmission': 'manual',
 'trim': 'A 160',
 'vin': None,
 'year': 2021}
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879042%27 HTTP/1.1" 200 None
2026-01-28 20:09:37 [ayvens.be] INFO: Saving data for 1879042: {'created_time': 1769630977.92777, 'last_price_update_time': 1769630977.927839, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879042') HTTP/1.1" 204 0
2026-01-28 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/14.jpg not downloaded yet
2026-01-28 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:38 [ayvens.be] INFO: Found listing with ID: 1879044
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879044%27 HTTP/1.1" 200 None
2026-01-28 20:09:38 [ayvens.be] INFO: Scrape type for 1879044: 1
2026-01-28 20:09:38 [ayvens.be] INFO: Extracting data for car ID: 1879044
2026-01-28 20:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9102d1-adb4-54bd-b9a2-a8306bdf6235 with identifier: 1879044
2026-01-28 20:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9102d1-adb4-54bd-b9a2-a8306bdf6235 with scrape type 1
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/1.jpg not downloaded yet
2026-01-28 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/2.jpg not downloaded yet
2026-01-28 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/3.jpg not downloaded yet
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d511d0>
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/3.jpg saved to cache
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/4.jpg not downloaded yet
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff17d0>
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/5.jpg saved to cache
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3081ad0>
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/6.jpg saved to cache
2026-01-28 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd1350>
2026-01-28 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/7.jpg saved to cache
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/5.jpg not downloaded yet
2026-01-28 20:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3f2d0>
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/9.jpg saved to cache
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeae90>
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/10.jpg saved to cache
2026-01-28 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b42790>
2026-01-28 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/8.jpg saved to cache
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53410>
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/4.jpg saved to cache
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/6.jpg not downloaded yet
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/7.jpg not downloaded yet
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14e10>
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/12.jpg saved to cache
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/8.jpg not downloaded yet
2026-01-28 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/9.jpg not downloaded yet
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2decf90>
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/13.jpg saved to cache
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6a50>
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/11.jpg saved to cache
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def350>
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/1.jpg saved to cache
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6210>
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fu%252F8f84c4732eee499b85ac8efb154cc617%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/14.jpg saved to cache
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5784ffd9-552b-5725-9467-19e6a75a898c
2026-01-28 20:09:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5784ffd9-552b-5725-9467-19e6a75a898c, skipping ID generation
2026-01-28 20:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5784ffd9-552b-5725-9467-19e6a75a898c with scrape type 1
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5784ffd9-552b-5725-9467-19e6a75a898c from tracking dictionaries
2026-01-28 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5784ffd9-552b-5725-9467-19e6a75a898c sending to next pipeline
2026-01-28 20:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5784ffd9-552b-5725-9467-19e6a75a898c, identifier: 1879043
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c910>
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/2.jpg saved to cache
2026-01-28 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/10.jpg not downloaded yet
2026-01-28 20:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5784ffd9-552b-5725-9467-19e6a75a898c with identifier: 1879043
2026-01-28 20:09:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5784ffd9-552b-5725-9467-19e6a75a898c with identifier: 1879043
2026-01-28 20:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5784ffd9-552b-5725-9467-19e6a75a898c with identifier: 1879043 to the API
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'DIGITAL WHITE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '5784ffd9-552b-5725-9467-19e6a75a898c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQB',
 'odometer': 9978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464766,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320641,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258892,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386307,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5784ffd9-552b-5725-9467-19e6a75a898c/5784ffd9-552b-5725-9467-19e6a75a898c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fu/8f84c4732eee499b85ac8efb154cc617/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQB BEV 71KWH EQB 250+ LUXURY LINE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 71KWH EQB 250+ LUXURY LINE AUTO',
 'vin': None,
 'year': 2024}
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879043%27 HTTP/1.1" 200 None
2026-01-28 20:09:42 [ayvens.be] INFO: Saving data for 1879043: {'created_time': 1769630982.740556, 'last_price_update_time': 1769630982.740567, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879043') HTTP/1.1" 204 0
2026-01-28 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/11.jpg not downloaded yet
2026-01-28 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3990>
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/3.jpg saved to cache
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97ad0>
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/5.jpg saved to cache
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/12.jpg not downloaded yet
2026-01-28 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/13.jpg not downloaded yet
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de9a50>
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/4.jpg saved to cache
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4f3d0>
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/6.jpg saved to cache
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/14.jpg not downloaded yet
2026-01-28 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:43 [ayvens.be] INFO: Found listing with ID: 1879045
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879045%27 HTTP/1.1" 200 None
2026-01-28 20:09:43 [ayvens.be] INFO: Scrape type for 1879045: 1
2026-01-28 20:09:43 [ayvens.be] INFO: Extracting data for car ID: 1879045
2026-01-28 20:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d0c3b3-4f08-58eb-a8bf-137192524b67 with identifier: 1879045
2026-01-28 20:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d0c3b3-4f08-58eb-a8bf-137192524b67 with scrape type 1
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/1.jpg not downloaded yet
2026-01-28 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b90550>
2026-01-28 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/7.jpg saved to cache
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f069d0>
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/8.jpg saved to cache
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/2.jpg not downloaded yet
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/3.jpg not downloaded yet
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dea890>
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/9.jpg saved to cache
2026-01-28 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a690>
2026-01-28 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/11.jpg saved to cache
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/4.jpg not downloaded yet
2026-01-28 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/5.jpg not downloaded yet
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6450>
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/10.jpg saved to cache
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/6.jpg not downloaded yet
2026-01-28 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/7.jpg not downloaded yet
2026-01-28 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2f50>
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/12.jpg saved to cache
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97a50>
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/13.jpg saved to cache
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/8.jpg not downloaded yet
2026-01-28 20:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/9.jpg not downloaded yet
2026-01-28 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2f90>
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252Fa7fee41f83e2492c8f237b31ec17e99f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/14.jpg saved to cache
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item df9102d1-adb4-54bd-b9a2-a8306bdf6235
2026-01-28 20:09:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df9102d1-adb4-54bd-b9a2-a8306bdf6235, skipping ID generation
2026-01-28 20:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9102d1-adb4-54bd-b9a2-a8306bdf6235 with scrape type 1
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df9102d1-adb4-54bd-b9a2-a8306bdf6235 from tracking dictionaries
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df9102d1-adb4-54bd-b9a2-a8306bdf6235 sending to next pipeline
2026-01-28 20:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df9102d1-adb4-54bd-b9a2-a8306bdf6235, identifier: 1879044
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad9a0c7d0>
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/1.jpg saved to cache
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/10.jpg not downloaded yet
2026-01-28 20:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df9102d1-adb4-54bd-b9a2-a8306bdf6235 with identifier: 1879044
2026-01-28 20:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df9102d1-adb4-54bd-b9a2-a8306bdf6235 with identifier: 1879044
2026-01-28 20:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df9102d1-adb4-54bd-b9a2-a8306bdf6235 with identifier: 1879044 to the API
2026-01-28 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df9102d1-adb4-54bd-b9a2-a8306bdf6235',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 60243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331400,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357619,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 327370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9102d1-adb4-54bd-b9a2-a8306bdf6235/df9102d1-adb4-54bd-b9a2-a8306bdf6235_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/a7fee41f83e2492c8f237b31ec17e99f/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.6 E-TECH 145 CORPORATE EDITION',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH 145 CORPORATE EDITION',
 'vin': None,
 'year': 2022}
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879044%27 HTTP/1.1" 200 None
2026-01-28 20:09:47 [ayvens.be] INFO: Saving data for 1879044: {'created_time': 1769630987.932586, 'last_price_update_time': 1769630987.932599, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879044') HTTP/1.1" 204 0
2026-01-28 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/11.jpg not downloaded yet
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec5810>
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/3.jpg saved to cache
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f998d0>
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/2.jpg saved to cache
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e15b10>
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/4.jpg saved to cache
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/12.jpg not downloaded yet
2026-01-28 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/13.jpg not downloaded yet
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53250>
2026-01-28 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/5.jpg saved to cache
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:49 [ayvens.be] INFO: Found listing with ID: 1879046
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879046%27 HTTP/1.1" 200 None
2026-01-28 20:09:49 [ayvens.be] INFO: Scrape type for 1879046: 1
2026-01-28 20:09:49 [ayvens.be] INFO: Extracting data for car ID: 1879046
2026-01-28 20:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e2bc9e-f117-52a7-ae24-1d94556be882 with identifier: 1879046
2026-01-28 20:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e2bc9e-f117-52a7-ae24-1d94556be882 with scrape type 1
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/1.jpg not downloaded yet
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea19d0>
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/6.jpg saved to cache
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57b90>
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/7.jpg saved to cache
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/2.jpg not downloaded yet
2026-01-28 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/3.jpg not downloaded yet
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df6ed0>
2026-01-28 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/8.jpg saved to cache
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/4.jpg not downloaded yet
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cce950>
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/9.jpg saved to cache
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e15050>
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/10.jpg saved to cache
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/5.jpg not downloaded yet
2026-01-28 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/6.jpg not downloaded yet
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea3e90>
2026-01-28 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/11.jpg saved to cache
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/7.jpg not downloaded yet
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0bd0>
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/12.jpg saved to cache
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2ed0>
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dd%252F14612825b0ef4e88a6b7ba697e77668b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/13.jpg saved to cache
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 14d0c3b3-4f08-58eb-a8bf-137192524b67
2026-01-28 20:09:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14d0c3b3-4f08-58eb-a8bf-137192524b67, skipping ID generation
2026-01-28 20:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d0c3b3-4f08-58eb-a8bf-137192524b67 with scrape type 1
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14d0c3b3-4f08-58eb-a8bf-137192524b67 from tracking dictionaries
2026-01-28 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14d0c3b3-4f08-58eb-a8bf-137192524b67 sending to next pipeline
2026-01-28 20:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 14d0c3b3-4f08-58eb-a8bf-137192524b67, identifier: 1879045
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/8.jpg not downloaded yet
2026-01-28 20:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 14d0c3b3-4f08-58eb-a8bf-137192524b67 with identifier: 1879045
2026-01-28 20:09:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 14d0c3b3-4f08-58eb-a8bf-137192524b67 with identifier: 1879045
2026-01-28 20:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 14d0c3b3-4f08-58eb-a8bf-137192524b67 with identifier: 1879045 to the API
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 21,
 'color': 'ORYX WHITE PEARL',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '14d0c3b3-4f08-58eb-a8bf-137192524b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 124555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306569,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279636,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14d0c3b3-4f08-58eb-a8bf-137192524b67/14d0c3b3-4f08-58eb-a8bf-137192524b67_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dd/14612825b0ef4e88a6b7ba697e77668b/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879045%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [ayvens.be] INFO: Saving data for 1879045: {'created_time': 1769630992.451411, 'last_price_update_time': 1769630992.451423, 'auction_closing_time': 1770192000.0}
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879045') HTTP/1.1" 204 0
2026-01-28 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/9.jpg not downloaded yet
2026-01-28 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/10.jpg not downloaded yet
2026-01-28 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/11.jpg not downloaded yet
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/12.jpg not downloaded yet
2026-01-28 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/13.jpg not downloaded yet
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/14.jpg not downloaded yet
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9bad0>
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/1.jpg saved to cache
2026-01-28 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/15.jpg not downloaded yet
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/16.jpg not downloaded yet
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/17.jpg not downloaded yet
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec8a10>
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/2.jpg saved to cache
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1bd0>
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/3.jpg saved to cache
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49f50>
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/4.jpg saved to cache
2026-01-28 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3dd50>
2026-01-28 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/5.jpg saved to cache
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/18.jpg not downloaded yet
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/19.jpg not downloaded yet
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/20.jpg not downloaded yet
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [ayvens.be] INFO: Found listing with ID: 1879047
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879047%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [ayvens.be] INFO: Scrape type for 1879047: 1
2026-01-28 20:09:54 [ayvens.be] INFO: Extracting data for car ID: 1879047
2026-01-28 20:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c204bea-546a-511c-bf46-e04503fa0e18 with identifier: 1879047
2026-01-28 20:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c204bea-546a-511c-bf46-e04503fa0e18 with scrape type 1
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/1.jpg not downloaded yet
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/2.jpg not downloaded yet
2026-01-28 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/3.jpg not downloaded yet
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2fb10>
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/6.jpg saved to cache
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/4.jpg not downloaded yet
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91bd0>
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/11.jpg saved to cache
2026-01-28 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8db90>
2026-01-28 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/10.jpg saved to cache
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/5.jpg not downloaded yet
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/6.jpg not downloaded yet
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35010>
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/8.jpg saved to cache
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df4d90>
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/7.jpg saved to cache
2026-01-28 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2be90>
2026-01-28 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/9.jpg saved to cache
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1ad0>
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/12.jpg saved to cache
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9ab50>
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/13.jpg saved to cache
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/7.jpg not downloaded yet
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/8.jpg not downloaded yet
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/9.jpg not downloaded yet
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/10.jpg not downloaded yet
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/11.jpg not downloaded yet
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/12.jpg not downloaded yet
2026-01-28 20:09:56 [ayvens.be] INFO: Found listing with ID: 1879048
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879048%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [ayvens.be] INFO: Scrape type for 1879048: 1
2026-01-28 20:09:56 [ayvens.be] INFO: Extracting data for car ID: 1879048
2026-01-28 20:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 with identifier: 1879048
2026-01-28 20:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 with scrape type 1
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/1.jpg not downloaded yet
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/2.jpg not downloaded yet
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8d550>
2026-01-28 20:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/16.jpg saved to cache
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90610>
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/15.jpg saved to cache
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080310>
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/17.jpg saved to cache
2026-01-28 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90410>
2026-01-28 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/14.jpg saved to cache
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e92a50>
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/18.jpg saved to cache
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6c350>
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/19.jpg saved to cache
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/3.jpg not downloaded yet
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/4.jpg not downloaded yet
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/5.jpg not downloaded yet
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/6.jpg not downloaded yet
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/7.jpg not downloaded yet
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/8.jpg not downloaded yet
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/9.jpg not downloaded yet
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/10.jpg not downloaded yet
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/11.jpg not downloaded yet
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74350>
2026-01-28 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/4.jpg saved to cache
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/12.jpg not downloaded yet
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/13.jpg not downloaded yet
2026-01-28 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/14.jpg not downloaded yet
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36c50>
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/1.jpg saved to cache
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edca50>
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/2.jpg saved to cache
2026-01-28 20:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeae50>
2026-01-28 20:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/7.jpg saved to cache
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eaeb10>
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/5.jpg saved to cache
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9c90>
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/3.jpg saved to cache
2026-01-28 20:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef2190>
2026-01-28 20:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cn%252Fcd0087e5c8004a0ab5abeb3b14739814%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/20.jpg saved to cache
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 01e2bc9e-f117-52a7-ae24-1d94556be882
2026-01-28 20:10:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01e2bc9e-f117-52a7-ae24-1d94556be882, skipping ID generation
2026-01-28 20:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e2bc9e-f117-52a7-ae24-1d94556be882 with scrape type 1
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 01e2bc9e-f117-52a7-ae24-1d94556be882 from tracking dictionaries
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01e2bc9e-f117-52a7-ae24-1d94556be882 sending to next pipeline
2026-01-28 20:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 01e2bc9e-f117-52a7-ae24-1d94556be882, identifier: 1879046
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef65d0>
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/6.jpg saved to cache
2026-01-28 20:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 01e2bc9e-f117-52a7-ae24-1d94556be882 with identifier: 1879046
2026-01-28 20:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 01e2bc9e-f117-52a7-ae24-1d94556be882 with identifier: 1879046
2026-01-28 20:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 01e2bc9e-f117-52a7-ae24-1d94556be882 spider: ayvens.be
2026-01-28 20:10:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 01e2bc9e-f117-52a7-ae24-1d94556be882 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '01e2bc9e-f117-52a7-ae24-1d94556be882',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 30536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563682,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715310,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 744122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629681,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e2bc9e-f117-52a7-ae24-1d94556be882/01e2bc9e-f117-52a7-ae24-1d94556be882_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cn/cd0087e5c8004a0ab5abeb3b14739814/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1',
 'vin': None,
 'year': 2022}
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879046%27 HTTP/1.1" 200 None
2026-01-28 20:10:01 [ayvens.be] INFO: Saving data for 1879046: {'created_time': 1769631001.979499, 'last_price_update_time': 1769631001.979513, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879046') HTTP/1.1" 204 0
2026-01-28 20:10:02 [ayvens.be] INFO: Found listing with ID: 1879049
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879049%27 HTTP/1.1" 200 None
2026-01-28 20:10:02 [ayvens.be] INFO: Scrape type for 1879049: 1
2026-01-28 20:10:02 [ayvens.be] INFO: Extracting data for car ID: 1879049
2026-01-28 20:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 948d4026-5b37-5cca-9b7f-7b32a259d5fa with identifier: 1879049
2026-01-28 20:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa with scrape type 1
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg not downloaded yet
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg not downloaded yet
2026-01-28 20:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3490>
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/2.jpg saved to cache
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed8190>
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/3.jpg saved to cache
2026-01-28 20:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6f90>
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/1.jpg saved to cache
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg not downloaded yet
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg not downloaded yet
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfae50>
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/12.jpg saved to cache
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg not downloaded yet
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg not downloaded yet
2026-01-28 20:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98410>
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/11.jpg saved to cache
2026-01-28 20:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66410>
2026-01-28 20:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/9.jpg saved to cache
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3083250>
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/10.jpg saved to cache
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec850>
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/4.jpg saved to cache
2026-01-28 20:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6f310>
2026-01-28 20:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/6.jpg saved to cache
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1f1d0>
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F759b12262c7b45b5998c29d5ae471bc3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/8.jpg saved to cache
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c204bea-546a-511c-bf46-e04503fa0e18
2026-01-28 20:10:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c204bea-546a-511c-bf46-e04503fa0e18, skipping ID generation
2026-01-28 20:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c204bea-546a-511c-bf46-e04503fa0e18 with scrape type 1
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c204bea-546a-511c-bf46-e04503fa0e18 from tracking dictionaries
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c204bea-546a-511c-bf46-e04503fa0e18 sending to next pipeline
2026-01-28 20:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4c204bea-546a-511c-bf46-e04503fa0e18, identifier: 1879047
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de06d0>
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/5.jpg saved to cache
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg not downloaded yet
2026-01-28 20:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4c204bea-546a-511c-bf46-e04503fa0e18 with identifier: 1879047
2026-01-28 20:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4c204bea-546a-511c-bf46-e04503fa0e18 with identifier: 1879047
2026-01-28 20:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4c204bea-546a-511c-bf46-e04503fa0e18 spider: ayvens.be
2026-01-28 20:10:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4c204bea-546a-511c-bf46-e04503fa0e18 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c204bea-546a-511c-bf46-e04503fa0e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 65866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800413,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c204bea-546a-511c-bf46-e04503fa0e18/4c204bea-546a-511c-bf46-e04503fa0e18_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/759b12262c7b45b5998c29d5ae471bc3/images/large/12.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879047%27 HTTP/1.1" 200 None
2026-01-28 20:10:06 [ayvens.be] INFO: Saving data for 1879047: {'created_time': 1769631006.095679, 'last_price_update_time': 1769631006.095689, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879047') HTTP/1.1" 204 0
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg not downloaded yet
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b40e50>
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/11.jpg saved to cache
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1effc50>
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/12.jpg saved to cache
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8e550>
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/10.jpg saved to cache
2026-01-28 20:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4a650>
2026-01-28 20:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/14.jpg saved to cache
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cafdd0>
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/13.jpg saved to cache
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg not downloaded yet
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cff90>
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/9.jpg saved to cache
2026-01-28 20:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff9ed0>
2026-01-28 20:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/7.jpg saved to cache
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffbd10>
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bb%252F060d5f10d1084d0d8948a452ff645447%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/8.jpg saved to cache
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485
2026-01-28 20:10:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485, skipping ID generation
2026-01-28 20:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 with scrape type 1
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 from tracking dictionaries
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 sending to next pipeline
2026-01-28 20:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485, identifier: 1879048
2026-01-28 20:10:08 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at -1 pages/min), scraped 35 items (at 7 items/min)
2026-01-28 20:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 with identifier: 1879048
2026-01-28 20:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 with identifier: 1879048
2026-01-28 20:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 spider: ayvens.be
2026-01-28 20:10:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 1d4d37bc-969d-54bc-9c2f-4b23d8ab4485 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '1d4d37bc-969d-54bc-9c2f-4b23d8ab4485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 40770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217144,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4d37bc-969d-54bc-9c2f-4b23d8ab4485/1d4d37bc-969d-54bc-9c2f-4b23d8ab4485_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159157,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bb/060d5f10d1084d0d8948a452ff645447/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879048%27 HTTP/1.1" 200 None
2026-01-28 20:10:08 [ayvens.be] INFO: Saving data for 1879048: {'created_time': 1769631008.783194, 'last_price_update_time': 1769631008.783205, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879048') HTTP/1.1" 204 0
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg not downloaded yet
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg not downloaded yet
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg not downloaded yet
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg not downloaded yet
2026-01-28 20:10:09 [ayvens.be] INFO: Found listing with ID: 1879050
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879050%27 HTTP/1.1" 200 None
2026-01-28 20:10:09 [ayvens.be] INFO: Scrape type for 1879050: 1
2026-01-28 20:10:09 [ayvens.be] INFO: Extracting data for car ID: 1879050
2026-01-28 20:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b13641d-c372-58bc-abbd-e694be489252 with identifier: 1879050
2026-01-28 20:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b13641d-c372-58bc-abbd-e694be489252 with scrape type 1
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/1.jpg not downloaded yet
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6edd0>
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg saved to cache
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/2.jpg not downloaded yet
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d17310>
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg saved to cache
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9c10>
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg saved to cache
2026-01-28 20:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e60ed0>
2026-01-28 20:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg saved to cache
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/3.jpg not downloaded yet
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51dd0>
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg saved to cache
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f52050>
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg saved to cache
2026-01-28 20:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5c150>
2026-01-28 20:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg saved to cache
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/4.jpg not downloaded yet
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61e10>
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg saved to cache
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/5.jpg not downloaded yet
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/6.jpg not downloaded yet
2026-01-28 20:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e21490>
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg saved to cache
2026-01-28 20:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c5ba90>
2026-01-28 20:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg saved to cache
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48f10>
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg saved to cache
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/7.jpg not downloaded yet
2026-01-28 20:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/8.jpg not downloaded yet
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de9ed0>
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg saved to cache
2026-01-28 20:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8590>
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gm%252F4c5d3ba3847b4f36affc99ee845b5405%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg saved to cache
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa
2026-01-28 20:10:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 948d4026-5b37-5cca-9b7f-7b32a259d5fa, skipping ID generation
2026-01-28 20:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa with scrape type 1
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 948d4026-5b37-5cca-9b7f-7b32a259d5fa from tracking dictionaries
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 948d4026-5b37-5cca-9b7f-7b32a259d5fa sending to next pipeline
2026-01-28 20:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 948d4026-5b37-5cca-9b7f-7b32a259d5fa, identifier: 1879049
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b12c10>
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/1.jpg saved to cache
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/9.jpg not downloaded yet
2026-01-28 20:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 948d4026-5b37-5cca-9b7f-7b32a259d5fa with identifier: 1879049
2026-01-28 20:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 948d4026-5b37-5cca-9b7f-7b32a259d5fa with identifier: 1879049
2026-01-28 20:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '4', 'trim': 'bev 100kwh lrdm business edition', 'title': 'polestar 4 bev 100kwh lrdm business edition', 'price': 0, 'odometer': 7146, 'odometer_reading_unit': 'km', 'registration_date': '2025-01-30', 'year': 2025, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176', 'expiration_date': '2026-02-04t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '948d4026-5b37-5cca-9b7f-7b32a259d5fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371480}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 293957}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 267035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 265837}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 274203}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 181800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325254}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308709}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'polestar 4', 'sanitized_make': 'polestar', 'odometer_in_km': 7146}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-04t08:00:00z',
     'fuel_type': 'electric',
     'id': '948d4026-5b37-5cca-9b7f-7b32a259d5fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 4',
     'model': '4',
     'odometer': 7146,
     'odometer_in_km': 7146,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 488518,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 429037,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 371742,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 371480,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 293957,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 267035,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301006,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 265837,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 274203,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 181800,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325254,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 361929,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 308709,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-01-30',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 4 bev 100kwh lrdm business edition',
     'transmission': 'automatic',
     'trim': 'bev 100kwh lrdm business edition',
     'vin': None,
     'year': 2025}
2026-01-28 20:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 948d4026-5b37-5cca-9b7f-7b32a259d5fa spider: ayvens.be
2026-01-28 20:10:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 948d4026-5b37-5cca-9b7f-7b32a259d5fa due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '4', 'trim': 'bev 100kwh lrdm business edition', 'title': 'polestar 4 bev 100kwh lrdm business edition', 'price': 0, 'odometer': 7146, 'odometer_reading_unit': 'km', 'registration_date': '2025-01-30', 'year': 2025, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176', 'expiration_date': '2026-02-04t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '948d4026-5b37-5cca-9b7f-7b32a259d5fa', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429037}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371742}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371480}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 293957}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 267035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301006}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 265837}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 274203}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 181800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 325254}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308709}], 'current_year_diff': 1, 'age_in_months': 11, 'make_model': 'polestar 4', 'sanitized_make': 'polestar', 'odometer_in_km': 7146}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 11,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 1,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-04t08:00:00z',
     'fuel_type': 'electric',
     'id': '948d4026-5b37-5cca-9b7f-7b32a259d5fa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 4',
     'model': '4',
     'odometer': 7146,
     'odometer_in_km': 7146,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 488518,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 429037,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 371742,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 371480,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 293957,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 267035,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301006,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 265837,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 274203,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 181800,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 325254,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 361929,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 308709,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2025-01-30',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 4 bev 100kwh lrdm business edition',
     'transmission': 'automatic',
     'trim': 'bev 100kwh lrdm business edition',
     'vin': None,
     'year': 2025}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '948d4026-5b37-5cca-9b7f-7b32a259d5fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '4',
 'odometer': 7146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293957,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274203,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181800,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325254,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948d4026-5b37-5cca-9b7f-7b32a259d5fa/948d4026-5b37-5cca-9b7f-7b32a259d5fa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gm/4c5d3ba3847b4f36affc99ee845b5405/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 4 BEV 100KWH LRDM BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': 'BEV 100KWH LRDM BUSINESS EDITION',
 'vin': None,
 'year': 2025}
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879049%27 HTTP/1.1" 200 None
2026-01-28 20:10:13 [ayvens.be] INFO: Saving data for 1879049: {'created_time': 1769631013.810865, 'last_price_update_time': 1769631013.810874, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879049') HTTP/1.1" 204 0
2026-01-28 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/10.jpg not downloaded yet
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee1210>
2026-01-28 20:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/2.jpg saved to cache
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/11.jpg not downloaded yet
2026-01-28 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/12.jpg not downloaded yet
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df5e10>
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/3.jpg saved to cache
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8d50>
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/4.jpg saved to cache
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/13.jpg not downloaded yet
2026-01-28 20:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da4c50>
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/5.jpg saved to cache
2026-01-28 20:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e04c90>
2026-01-28 20:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/6.jpg saved to cache
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e040d0>
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/7.jpg saved to cache
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/14.jpg not downloaded yet
2026-01-28 20:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:15 [ayvens.be] INFO: Found listing with ID: 1879051
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879051%27 HTTP/1.1" 200 None
2026-01-28 20:10:15 [ayvens.be] INFO: Scrape type for 1879051: 1
2026-01-28 20:10:15 [ayvens.be] INFO: Extracting data for car ID: 1879051
2026-01-28 20:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f230d9-9894-58ac-9c91-fdabe89fc369 with identifier: 1879051
2026-01-28 20:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f230d9-9894-58ac-9c91-fdabe89fc369 with scrape type 1
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/1.jpg not downloaded yet
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edff90>
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/8.jpg saved to cache
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/2.jpg not downloaded yet
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0b390>
2026-01-28 20:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/9.jpg saved to cache
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/3.jpg not downloaded yet
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/4.jpg not downloaded yet
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b92d50>
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/10.jpg saved to cache
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05490>
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/11.jpg saved to cache
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/5.jpg not downloaded yet
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/6.jpg not downloaded yet
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/7.jpg not downloaded yet
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/8.jpg not downloaded yet
2026-01-28 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/9.jpg not downloaded yet
2026-01-28 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/10.jpg not downloaded yet
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/11.jpg not downloaded yet
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c532d0>
2026-01-28 20:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/12.jpg saved to cache
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed3150>
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/13.jpg saved to cache
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26dd0>
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2gq%252Fd44e4d0940b945839114ef24f0b2471f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/14.jpg saved to cache
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0b13641d-c372-58bc-abbd-e694be489252
2026-01-28 20:10:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b13641d-c372-58bc-abbd-e694be489252, skipping ID generation
2026-01-28 20:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b13641d-c372-58bc-abbd-e694be489252 with scrape type 1
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b13641d-c372-58bc-abbd-e694be489252 from tracking dictionaries
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b13641d-c372-58bc-abbd-e694be489252 sending to next pipeline
2026-01-28 20:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0b13641d-c372-58bc-abbd-e694be489252, identifier: 1879050
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/12.jpg not downloaded yet
2026-01-28 20:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0b13641d-c372-58bc-abbd-e694be489252 with identifier: 1879050
2026-01-28 20:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0b13641d-c372-58bc-abbd-e694be489252 with identifier: 1879050
2026-01-28 20:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0b13641d-c372-58bc-abbd-e694be489252 with identifier: 1879050 to the API
2026-01-28 20:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'electric',
 'id': '0b13641d-c372-58bc-abbd-e694be489252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'SCAu2030NIC E-TECH',
 'odometer': 6792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373358,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331648,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 363974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 408051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b13641d-c372-58bc-abbd-e694be489252/0b13641d-c372-58bc-abbd-e694be489252_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251982,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2gq/d44e4d0940b945839114ef24f0b2471f/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT SCAu2030NIC E-TECH BEV 92KWH 220HP TECHNO',
 'transmission': 'automatic',
 'trim': 'BEV 92KWH 220HP TECHNO',
 'vin': None,
 'year': 2025}
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879050%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [ayvens.be] INFO: Saving data for 1879050: {'created_time': 1769631018.18583, 'last_price_update_time': 1769631018.185839, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879050') HTTP/1.1" 204 0
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/13.jpg not downloaded yet
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cafb50>
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/2.jpg saved to cache
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31490>
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/1.jpg saved to cache
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [ayvens.be] INFO: Found listing with ID: 1879052
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879052%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [ayvens.be] INFO: Scrape type for 1879052: 1
2026-01-28 20:10:18 [ayvens.be] INFO: Extracting data for car ID: 1879052
2026-01-28 20:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f318d1-0c96-5d44-92fd-22c09f6abdd8 with identifier: 1879052
2026-01-28 20:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8 with scrape type 1
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/1.jpg not downloaded yet
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/2.jpg not downloaded yet
2026-01-28 20:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/3.jpg not downloaded yet
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/4.jpg not downloaded yet
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/5.jpg not downloaded yet
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/6.jpg not downloaded yet
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57e10>
2026-01-28 20:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/9.jpg saved to cache
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/7.jpg not downloaded yet
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/8.jpg not downloaded yet
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c5d0>
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/4.jpg saved to cache
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43bd0>
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/6.jpg saved to cache
2026-01-28 20:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8df50>
2026-01-28 20:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/5.jpg saved to cache
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75fd0>
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/8.jpg saved to cache
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2e990>
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/7.jpg saved to cache
2026-01-28 20:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1890>
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/3.jpg saved to cache
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2390>
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/10.jpg saved to cache
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/9.jpg not downloaded yet
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/10.jpg not downloaded yet
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/11.jpg not downloaded yet
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/12.jpg not downloaded yet
2026-01-28 20:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/13.jpg not downloaded yet
2026-01-28 20:10:21 [ayvens.be] INFO: Found listing with ID: 1879053
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879053%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [ayvens.be] INFO: Scrape type for 1879053: 1
2026-01-28 20:10:21 [ayvens.be] INFO: Extracting data for car ID: 1879053
2026-01-28 20:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with identifier: 1879053
2026-01-28 20:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with scrape type 1
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/1.jpg not downloaded yet
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/2.jpg not downloaded yet
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/3.jpg not downloaded yet
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeafd0>
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/12.jpg saved to cache
2026-01-28 20:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6710>
2026-01-28 20:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/13.jpg saved to cache
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9850>
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dg%252Fac2c090164ea42d8b52cfd8aac3f8cf2%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/11.jpg saved to cache
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d5f230d9-9894-58ac-9c91-fdabe89fc369
2026-01-28 20:10:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f230d9-9894-58ac-9c91-fdabe89fc369, skipping ID generation
2026-01-28 20:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f230d9-9894-58ac-9c91-fdabe89fc369 with scrape type 1
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d5f230d9-9894-58ac-9c91-fdabe89fc369 from tracking dictionaries
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f230d9-9894-58ac-9c91-fdabe89fc369 sending to next pipeline
2026-01-28 20:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d5f230d9-9894-58ac-9c91-fdabe89fc369, identifier: 1879051
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9490>
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/4.jpg saved to cache
2026-01-28 20:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d5f230d9-9894-58ac-9c91-fdabe89fc369 with identifier: 1879051
2026-01-28 20:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d5f230d9-9894-58ac-9c91-fdabe89fc369 with identifier: 1879051
2026-01-28 20:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d5f230d9-9894-58ac-9c91-fdabe89fc369 with identifier: 1879051 to the API
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd5f230d9-9894-58ac-9c91-fdabe89fc369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE',
 'odometer': 44124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453487,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 317742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 340060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f230d9-9894-58ac-9c91-fdabe89fc369/d5f230d9-9894-58ac-9c91-fdabe89fc369_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dg/ac2c090164ea42d8b52cfd8aac3f8cf2/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'LAND ROVER RANGE ROVER EVOQUE 1.5 P300E PHEV 4WD AUTO R-DYNAMIC S',
 'transmission': 'automatic',
 'trim': '1.5 P300E PHEV 4WD AUTO R-DYNAMIC S',
 'vin': None,
 'year': 2023}
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879051%27 HTTP/1.1" 200 None
2026-01-28 20:10:23 [ayvens.be] INFO: Saving data for 1879051: {'created_time': 1769631023.381373, 'last_price_update_time': 1769631023.381384, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879051') HTTP/1.1" 204 0
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/4.jpg not downloaded yet
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fca950>
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/3.jpg saved to cache
2026-01-28 20:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9b810>
2026-01-28 20:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/2.jpg saved to cache
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cf810>
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/1.jpg saved to cache
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c6890>
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/5.jpg saved to cache
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/5.jpg not downloaded yet
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/6.jpg not downloaded yet
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/7.jpg not downloaded yet
2026-01-28 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/8.jpg not downloaded yet
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/9.jpg not downloaded yet
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/10.jpg not downloaded yet
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/11.jpg not downloaded yet
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/12.jpg not downloaded yet
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef7c90>
2026-01-28 20:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/10.jpg saved to cache
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26c90>
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/12.jpg saved to cache
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/13.jpg not downloaded yet
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7310>
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/8.jpg saved to cache
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f15590>
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/11.jpg saved to cache
2026-01-28 20:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0050>
2026-01-28 20:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/13.jpg saved to cache
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52990>
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/9.jpg saved to cache
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/14.jpg not downloaded yet
2026-01-28 20:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de13d0>
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/7.jpg saved to cache
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e62b50>
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ce%252F5deae7986be7433e87aaba1e3034eda1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/6.jpg saved to cache
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8
2026-01-28 20:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8f318d1-0c96-5d44-92fd-22c09f6abdd8, skipping ID generation
2026-01-28 20:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8 with scrape type 1
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c8f318d1-0c96-5d44-92fd-22c09f6abdd8 from tracking dictionaries
2026-01-28 20:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8f318d1-0c96-5d44-92fd-22c09f6abdd8 sending to next pipeline
2026-01-28 20:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c8f318d1-0c96-5d44-92fd-22c09f6abdd8, identifier: 1879052
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48d10>
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/2.jpg saved to cache
2026-01-28 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:27 [ayvens.be] INFO: Found listing with ID: 1878634
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878634%27 HTTP/1.1" 200 None
2026-01-28 20:10:27 [ayvens.be] INFO: Scrape type for 1878634: 1
2026-01-28 20:10:27 [ayvens.be] INFO: Extracting data for car ID: 1878634
2026-01-28 20:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2261118c-80f9-594c-a60a-66b51a06e0c9 with identifier: 1878634
2026-01-28 20:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2261118c-80f9-594c-a60a-66b51a06e0c9 with scrape type 1
2026-01-28 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/1.jpg not downloaded yet
2026-01-28 20:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c8f318d1-0c96-5d44-92fd-22c09f6abdd8 with identifier: 1879052
2026-01-28 20:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c8f318d1-0c96-5d44-92fd-22c09f6abdd8 with identifier: 1879052
2026-01-28 20:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132954 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132954
2026-01-28 20:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c8f318d1-0c96-5d44-92fd-22c09f6abdd8 spider: ayvens.be
2026-01-28 20:10:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c8f318d1-0c96-5d44-92fd-22c09f6abdd8 due to rule: high_mileage_for_country.json, error: 132954 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132954
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'c8f318d1-0c96-5d44-92fd-22c09f6abdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'IBIZA 5D',
 'odometer': 132954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351791,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8f318d1-0c96-5d44-92fd-22c09f6abdd8/c8f318d1-0c96-5d44-92fd-22c09f6abdd8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ce/5deae7986be7433e87aaba1e3034eda1/images/large/13.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT IBIZA 5D 1.0 TSI 70KW S-S MOVE+rnNEW REGISTRATION DOCU  '
          '2HWE939',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW S-S MOVE+rnNEW REGISTRATION DOCU  2HWE939',
 'vin': None,
 'year': 2022}
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879052%27 HTTP/1.1" 200 None
2026-01-28 20:10:27 [ayvens.be] INFO: Saving data for 1879052: {'created_time': 1769631027.755046, 'last_price_update_time': 1769631027.755056, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879052') HTTP/1.1" 204 0
2026-01-28 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/2.jpg not downloaded yet
2026-01-28 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebb8d0>
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/3.jpg saved to cache
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9a390>
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/4.jpg saved to cache
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5b90>
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/8.jpg saved to cache
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86fd0>
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/1.jpg saved to cache
2026-01-28 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b252d0>
2026-01-28 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/5.jpg saved to cache
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51650>
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/6.jpg saved to cache
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/3.jpg not downloaded yet
2026-01-28 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/4.jpg not downloaded yet
2026-01-28 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f36d50>
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/7.jpg saved to cache
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c77d0>
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/9.jpg saved to cache
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/5.jpg not downloaded yet
2026-01-28 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/6.jpg not downloaded yet
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cdcd0>
2026-01-28 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/11.jpg saved to cache
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de2690>
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/12.jpg saved to cache
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c250>
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/10.jpg saved to cache
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7afd0>
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/14.jpg saved to cache
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/7.jpg not downloaded yet
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b119d0>
2026-01-28 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fb%252F853c263aecf54da89fe3498e2d0fa697%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/13.jpg saved to cache
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3
2026-01-28 20:10:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3, skipping ID generation
2026-01-28 20:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with scrape type 1
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 from tracking dictionaries
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 sending to next pipeline
2026-01-28 20:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3, identifier: 1879053
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/8.jpg not downloaded yet
2026-01-28 20:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with identifier: 1879053
2026-01-28 20:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with identifier: 1879053
2026-01-28 20:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3 with identifier: 1879053 to the API
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-04T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39176',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1 SPORTBACK',
 'odometer': 29317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163290,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3/2d1f780f-9a8e-59b4-8fc7-ba1aa93e73a3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fb/853c263aecf54da89fe3498e2d0fa697/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 SPORTBACK 1.0 25 TFSI ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 25 TFSI ATTRACTION',
 'vin': None,
 'year': 2024}
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271879053%27 HTTP/1.1" 200 None
2026-01-28 20:10:31 [ayvens.be] INFO: Saving data for 1879053: {'created_time': 1769631031.943549, 'last_price_update_time': 1769631031.943558, 'auction_closing_time': 1770192000.0}
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1879053') HTTP/1.1" 204 0
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/9.jpg not downloaded yet
2026-01-28 20:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/10.jpg not downloaded yet
2026-01-28 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/11.jpg not downloaded yet
2026-01-28 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/12.jpg not downloaded yet
2026-01-28 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/13.jpg not downloaded yet
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/14.jpg not downloaded yet
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/15.jpg not downloaded yet
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/16.jpg not downloaded yet
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da6310>
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/2.jpg saved to cache
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/17.jpg not downloaded yet
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7e3d0>
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/1.jpg saved to cache
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/18.jpg not downloaded yet
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e21310>
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/3.jpg saved to cache
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87c90>
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/4.jpg saved to cache
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce8c50>
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/5.jpg saved to cache
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/19.jpg not downloaded yet
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/20.jpg not downloaded yet
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffae50>
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/7.jpg saved to cache
2026-01-28 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:33 [ayvens.be] INFO: Found listing with ID: 1878635
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878635%27 HTTP/1.1" 200 None
2026-01-28 20:10:33 [ayvens.be] INFO: Scrape type for 1878635: 1
2026-01-28 20:10:33 [ayvens.be] INFO: Extracting data for car ID: 1878635
2026-01-28 20:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e545a28c-fb79-5e18-8b47-ecb0262d443e with identifier: 1878635
2026-01-28 20:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e545a28c-fb79-5e18-8b47-ecb0262d443e with scrape type 1
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/1.jpg not downloaded yet
2026-01-28 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/2.jpg not downloaded yet
2026-01-28 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/3.jpg not downloaded yet
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/4.jpg not downloaded yet
2026-01-28 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/5.jpg not downloaded yet
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/6.jpg not downloaded yet
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9290>
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/8.jpg saved to cache
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a44510>
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/6.jpg saved to cache
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23a90>
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/10.jpg saved to cache
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/7.jpg not downloaded yet
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/8.jpg not downloaded yet
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/9.jpg not downloaded yet
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c25a10>
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/11.jpg saved to cache
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de2210>
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/9.jpg saved to cache
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e60250>
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/12.jpg saved to cache
2026-01-28 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29850>
2026-01-28 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/13.jpg saved to cache
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2f2d0>
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/14.jpg saved to cache
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/10.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/11.jpg not downloaded yet
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/12.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/13.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/14.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/15.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/16.jpg not downloaded yet
2026-01-28 20:10:36 [ayvens.be] INFO: Found listing with ID: 1878636
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878636%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [ayvens.be] INFO: Scrape type for 1878636: 1
2026-01-28 20:10:36 [ayvens.be] INFO: Extracting data for car ID: 1878636
2026-01-28 20:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06227169-4de2-5e85-92ba-030b8bf1e377 with identifier: 1878636
2026-01-28 20:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06227169-4de2-5e85-92ba-030b8bf1e377 with scrape type 1
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/1.jpg not downloaded yet
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/2.jpg not downloaded yet
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd24d0>
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/16.jpg saved to cache
2026-01-28 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1cd90>
2026-01-28 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/18.jpg saved to cache
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1d0d0>
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/2.jpg saved to cache
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1d950>
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/17.jpg saved to cache
2026-01-28 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0e10>
2026-01-28 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/1.jpg saved to cache
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1ce90>
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/15.jpg saved to cache
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8cb50>
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/20.jpg saved to cache
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3e890>
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252Fb219a04ba4474c608daacd01cccec0e3%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/19.jpg saved to cache
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2261118c-80f9-594c-a60a-66b51a06e0c9
2026-01-28 20:10:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2261118c-80f9-594c-a60a-66b51a06e0c9, skipping ID generation
2026-01-28 20:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2261118c-80f9-594c-a60a-66b51a06e0c9 with scrape type 1
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2261118c-80f9-594c-a60a-66b51a06e0c9 from tracking dictionaries
2026-01-28 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2261118c-80f9-594c-a60a-66b51a06e0c9 sending to next pipeline
2026-01-28 20:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2261118c-80f9-594c-a60a-66b51a06e0c9, identifier: 1878634
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/3.jpg not downloaded yet
2026-01-28 20:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2261118c-80f9-594c-a60a-66b51a06e0c9 with identifier: 1878634
2026-01-28 20:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2261118c-80f9-594c-a60a-66b51a06e0c9 with identifier: 1878634
2026-01-28 20:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141390 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    141390
2026-01-28 20:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2261118c-80f9-594c-a60a-66b51a06e0c9 spider: ayvens.be
2026-01-28 20:10:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2261118c-80f9-594c-a60a-66b51a06e0c9 due to rule: high_mileage_for_country.json, error: 141390 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    141390
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2261118c-80f9-594c-a60a-66b51a06e0c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 141390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662515,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558864,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2261118c-80f9-594c-a60a-66b51a06e0c9/2261118c-80f9-594c-a60a-66b51a06e0c9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/b219a04ba4474c608daacd01cccec0e3/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 2.0 A 200 D BUSINESS SOLUTION LIM '
          'DCT',
 'transmission': 'automatic',
 'trim': '2.0 A 200 D BUSINESS SOLUTION LIM DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878634%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [ayvens.be] INFO: Saving data for 1878634: {'created_time': 1769631039.541024, 'last_price_update_time': 1769631039.541032, 'auction_closing_time': 1770107400.0}
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878634') HTTP/1.1" 204 0
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/4.jpg not downloaded yet
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/5.jpg not downloaded yet
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/6.jpg not downloaded yet
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/7.jpg not downloaded yet
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/8.jpg not downloaded yet
2026-01-28 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/9.jpg not downloaded yet
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/10.jpg not downloaded yet
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/11.jpg not downloaded yet
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/12.jpg not downloaded yet
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75550>
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/5.jpg saved to cache
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48210>
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/3.jpg saved to cache
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/13.jpg not downloaded yet
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff1bd0>
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/7.jpg saved to cache
2026-01-28 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b42f90>
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/10.jpg saved to cache
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff0f10>
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/9.jpg saved to cache
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/14.jpg not downloaded yet
2026-01-28 20:10:41 [ayvens.be] INFO: Found listing with ID: 1878637
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878637%27 HTTP/1.1" 200 None
2026-01-28 20:10:41 [ayvens.be] INFO: Scrape type for 1878637: 1
2026-01-28 20:10:41 [ayvens.be] INFO: Extracting data for car ID: 1878637
2026-01-28 20:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8949f964-df5d-528a-83bf-170e9d83d987 with identifier: 1878637
2026-01-28 20:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8949f964-df5d-528a-83bf-170e9d83d987 with scrape type 1
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/1.jpg not downloaded yet
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4d850>
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/4.jpg saved to cache
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0550>
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/6.jpg saved to cache
2026-01-28 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef18d0>
2026-01-28 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/8.jpg saved to cache
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/2.jpg not downloaded yet
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/3.jpg not downloaded yet
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/4.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/5.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/6.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/7.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/8.jpg not downloaded yet
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a59a90>
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/2.jpg saved to cache
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/9.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/10.jpg not downloaded yet
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/11.jpg not downloaded yet
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14950>
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/13.jpg saved to cache
2026-01-28 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db6290>
2026-01-28 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/3.jpg saved to cache
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17a50>
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/12.jpg saved to cache
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30ebdd0>
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/15.jpg saved to cache
2026-01-28 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea91d0>
2026-01-28 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/1.jpg saved to cache
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f15250>
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/16.jpg saved to cache
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03bd0>
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/14.jpg saved to cache
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/12.jpg not downloaded yet
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/13.jpg not downloaded yet
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/14.jpg not downloaded yet
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/15.jpg not downloaded yet
2026-01-28 20:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/16.jpg not downloaded yet
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/17.jpg not downloaded yet
2026-01-28 20:10:44 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-01-28 20:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76fd0>
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/5.jpg saved to cache
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad9776850>
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/10.jpg saved to cache
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfae50>
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F50d494989c35438186bdf385a42c3185%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/11.jpg saved to cache
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e545a28c-fb79-5e18-8b47-ecb0262d443e
2026-01-28 20:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e545a28c-fb79-5e18-8b47-ecb0262d443e, skipping ID generation
2026-01-28 20:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e545a28c-fb79-5e18-8b47-ecb0262d443e with scrape type 1
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e545a28c-fb79-5e18-8b47-ecb0262d443e from tracking dictionaries
2026-01-28 20:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e545a28c-fb79-5e18-8b47-ecb0262d443e sending to next pipeline
2026-01-28 20:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e545a28c-fb79-5e18-8b47-ecb0262d443e, identifier: 1878635
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad9a0cbd0>
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/9.jpg saved to cache
2026-01-28 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49a90>
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/4.jpg saved to cache
2026-01-28 20:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e553d0>
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/6.jpg saved to cache
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e88c50>
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/7.jpg saved to cache
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc2fd0>
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/8.jpg saved to cache
2026-01-28 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e545a28c-fb79-5e18-8b47-ecb0262d443e with identifier: 1878635
2026-01-28 20:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e545a28c-fb79-5e18-8b47-ecb0262d443e with identifier: 1878635
2026-01-28 20:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154184 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    154184
2026-01-28 20:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e545a28c-fb79-5e18-8b47-ecb0262d443e spider: ayvens.be
2026-01-28 20:10:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e545a28c-fb79-5e18-8b47-ecb0262d443e due to rule: high_mileage_for_country.json, error: 154184 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    154184
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e545a28c-fb79-5e18-8b47-ecb0262d443e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 154184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713967,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626839,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562492,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610380,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702321,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518590,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e545a28c-fb79-5e18-8b47-ecb0262d443e/e545a28c-fb79-5e18-8b47-ecb0262d443e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/50d494989c35438186bdf385a42c3185/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878635%27 HTTP/1.1" 200 None
2026-01-28 20:10:47 [ayvens.be] INFO: Saving data for 1878635: {'created_time': 1769631047.926708, 'last_price_update_time': 1769631047.926719, 'auction_closing_time': 1770107400.0}
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878635') HTTP/1.1" 204 0
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2cc90>
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/13.jpg saved to cache
2026-01-28 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6250>
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/3.jpg saved to cache
2026-01-28 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2d5d0>
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/14.jpg saved to cache
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da4e90>
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/1.jpg saved to cache
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5d550>
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/12.jpg saved to cache
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b903d0>
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yf%252F2cda698849a8497d9191110147d3578d%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/11.jpg saved to cache
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 06227169-4de2-5e85-92ba-030b8bf1e377
2026-01-28 20:10:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06227169-4de2-5e85-92ba-030b8bf1e377, skipping ID generation
2026-01-28 20:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06227169-4de2-5e85-92ba-030b8bf1e377 with scrape type 1
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06227169-4de2-5e85-92ba-030b8bf1e377 from tracking dictionaries
2026-01-28 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06227169-4de2-5e85-92ba-030b8bf1e377 sending to next pipeline
2026-01-28 20:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06227169-4de2-5e85-92ba-030b8bf1e377, identifier: 1878636
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbf990>
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/2.jpg saved to cache
2026-01-28 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b90e90>
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/4.jpg saved to cache
2026-01-28 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06227169-4de2-5e85-92ba-030b8bf1e377 with identifier: 1878636
2026-01-28 20:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06227169-4de2-5e85-92ba-030b8bf1e377 with identifier: 1878636
2026-01-28 20:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173144 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    173144
2026-01-28 20:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 06227169-4de2-5e85-92ba-030b8bf1e377 spider: ayvens.be
2026-01-28 20:10:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 06227169-4de2-5e85-92ba-030b8bf1e377 due to rule: high_mileage_for_country.json, error: 173144 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    173144
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '06227169-4de2-5e85-92ba-030b8bf1e377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 173144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672704,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654471,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627673,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06227169-4de2-5e85-92ba-030b8bf1e377/06227169-4de2-5e85-92ba-030b8bf1e377_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yf/2cda698849a8497d9191110147d3578d/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 2.0 SDRIVE18DA (100KW)',
 'transmission': 'automatic',
 'trim': '2.0 SDRIVE18DA (100KW)',
 'vin': None,
 'year': 2020}
2026-01-28 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878636%27 HTTP/1.1" 200 None
2026-01-28 20:10:51 [ayvens.be] INFO: Saving data for 1878636: {'created_time': 1769631051.036798, 'last_price_update_time': 1769631051.036808, 'auction_closing_time': 1770107400.0}
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878636') HTTP/1.1" 204 0
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b120d0>
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/11.jpg saved to cache
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4a9d0>
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/17.jpg saved to cache
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51090>
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/13.jpg saved to cache
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:51 [ayvens.be] INFO: Found listing with ID: 1878638
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878638%27 HTTP/1.1" 200 None
2026-01-28 20:10:51 [ayvens.be] INFO: Scrape type for 1878638: 1
2026-01-28 20:10:51 [ayvens.be] INFO: Extracting data for car ID: 1878638
2026-01-28 20:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb with identifier: 1878638
2026-01-28 20:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb with scrape type 1
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/1.jpg not downloaded yet
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/2.jpg not downloaded yet
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e47510>
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/9.jpg saved to cache
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cdf10>
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/10.jpg saved to cache
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/3.jpg not downloaded yet
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4d3d0>
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/7.jpg saved to cache
2026-01-28 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5af10>
2026-01-28 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/12.jpg saved to cache
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54750>
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/8.jpg saved to cache
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36d50>
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/16.jpg saved to cache
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/4.jpg not downloaded yet
2026-01-28 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/5.jpg not downloaded yet
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/6.jpg not downloaded yet
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/7.jpg not downloaded yet
2026-01-28 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/8.jpg not downloaded yet
2026-01-28 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/9.jpg not downloaded yet
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/10.jpg not downloaded yet
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/11.jpg not downloaded yet
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5550>
2026-01-28 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/15.jpg saved to cache
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/12.jpg not downloaded yet
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e916d0>
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/14.jpg saved to cache
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/13.jpg not downloaded yet
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/14.jpg not downloaded yet
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54910>
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/5.jpg saved to cache
2026-01-28 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62910>
2026-01-28 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/1.jpg saved to cache
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/15.jpg not downloaded yet
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/16.jpg not downloaded yet
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/17.jpg not downloaded yet
2026-01-28 20:10:55 [ayvens.be] INFO: Found listing with ID: 1878639
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878639%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [ayvens.be] INFO: Scrape type for 1878639: 1
2026-01-28 20:10:55 [ayvens.be] INFO: Extracting data for car ID: 1878639
2026-01-28 20:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8edf29be-3613-58a4-815d-3a4da6f0db13 with identifier: 1878639
2026-01-28 20:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8edf29be-3613-58a4-815d-3a4da6f0db13 with scrape type 1
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/1.jpg not downloaded yet
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/2.jpg not downloaded yet
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/3.jpg not downloaded yet
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/4.jpg not downloaded yet
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ced0d0>
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/4.jpg saved to cache
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2bd0>
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/2.jpg saved to cache
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/5.jpg not downloaded yet
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/6.jpg not downloaded yet
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd2bd0>
2026-01-28 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2al%252F88cd3edf37304c028b234625a9bffd6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/6.jpg saved to cache
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8949f964-df5d-528a-83bf-170e9d83d987
2026-01-28 20:10:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8949f964-df5d-528a-83bf-170e9d83d987, skipping ID generation
2026-01-28 20:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8949f964-df5d-528a-83bf-170e9d83d987 with scrape type 1
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8949f964-df5d-528a-83bf-170e9d83d987 from tracking dictionaries
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8949f964-df5d-528a-83bf-170e9d83d987 sending to next pipeline
2026-01-28 20:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8949f964-df5d-528a-83bf-170e9d83d987, identifier: 1878637
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1490>
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/3.jpg saved to cache
2026-01-28 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6d10>
2026-01-28 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/5.jpg saved to cache
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e3d390>
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/6.jpg saved to cache
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8050>
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/8.jpg saved to cache
2026-01-28 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee90d0>
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/7.jpg saved to cache
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8949f964-df5d-528a-83bf-170e9d83d987 with identifier: 1878637
2026-01-28 20:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8949f964-df5d-528a-83bf-170e9d83d987 with identifier: 1878637
2026-01-28 20:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164047 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    164047
2026-01-28 20:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8949f964-df5d-528a-83bf-170e9d83d987 spider: ayvens.be
2026-01-28 20:10:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8949f964-df5d-528a-83bf-170e9d83d987 due to rule: high_mileage_for_country.json, error: 164047 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    164047
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8949f964-df5d-528a-83bf-170e9d83d987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 164047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549079,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677885,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642786,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700537,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629230,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577055,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447983,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8949f964-df5d-528a-83bf-170e9d83d987/8949f964-df5d-528a-83bf-170e9d83d987_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2al/88cd3edf37304c028b234625a9bffd6b/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 1.3 GLB 200 BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 GLB 200 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878637%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [ayvens.be] INFO: Saving data for 1878637: {'created_time': 1769631058.252399, 'last_price_update_time': 1769631058.252412, 'auction_closing_time': 1770107400.0}
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878637') HTTP/1.1" 204 0
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/7.jpg not downloaded yet
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/8.jpg not downloaded yet
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/9.jpg not downloaded yet
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/10.jpg not downloaded yet
2026-01-28 20:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/11.jpg not downloaded yet
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/12.jpg not downloaded yet
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/13.jpg not downloaded yet
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/14.jpg not downloaded yet
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/15.jpg not downloaded yet
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35ed0>
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/12.jpg saved to cache
2026-01-28 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cee310>
2026-01-28 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/9.jpg saved to cache
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:59 [ayvens.be] INFO: Found listing with ID: 1878640
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878640%27 HTTP/1.1" 200 None
2026-01-28 20:10:59 [ayvens.be] INFO: Scrape type for 1878640: 1
2026-01-28 20:10:59 [ayvens.be] INFO: Extracting data for car ID: 1878640
2026-01-28 20:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84189b38-db39-5a25-a86d-f30f6588febb with identifier: 1878640
2026-01-28 20:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84189b38-db39-5a25-a86d-f30f6588febb with scrape type 1
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg not downloaded yet
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f550>
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/13.jpg saved to cache
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded1d0>
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/10.jpg saved to cache
2026-01-28 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec950>
2026-01-28 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/11.jpg saved to cache
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61510>
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/14.jpg saved to cache
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49990>
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/16.jpg saved to cache
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg not downloaded yet
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg not downloaded yet
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17190>
2026-01-28 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/15.jpg saved to cache
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg not downloaded yet
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg not downloaded yet
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg not downloaded yet
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg not downloaded yet
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg not downloaded yet
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg not downloaded yet
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2990>
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/6.jpg saved to cache
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg not downloaded yet
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg not downloaded yet
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg not downloaded yet
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24650>
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/5.jpg saved to cache
2026-01-28 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2fa90>
2026-01-28 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/1.jpg saved to cache
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b253d0>
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/2.jpg saved to cache
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2c7d0>
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F68add6de3eab4fe9b5805f8edd984421%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/17.jpg saved to cache
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb
2026-01-28 20:11:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb, skipping ID generation
2026-01-28 20:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb with scrape type 1
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb from tracking dictionaries
2026-01-28 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56bf157a-919f-5a44-b064-8b7bd9f9f8cb sending to next pipeline
2026-01-28 20:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb, identifier: 1878638
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4aa50>
2026-01-28 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/4.jpg saved to cache
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2310>
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/7.jpg saved to cache
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec5110>
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/3.jpg saved to cache
2026-01-28 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb with identifier: 1878638
2026-01-28 20:11:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb with identifier: 1878638
2026-01-28 20:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152903 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152903
2026-01-28 20:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb spider: ayvens.be
2026-01-28 20:11:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 56bf157a-919f-5a44-b064-8b7bd9f9f8cb due to rule: high_mileage_for_country.json, error: 152903 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152903
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '56bf157a-919f-5a44-b064-8b7bd9f9f8cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 152903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721932,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56bf157a-919f-5a44-b064-8b7bd9f9f8cb/56bf157a-919f-5a44-b064-8b7bd9f9f8cb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/68add6de3eab4fe9b5805f8edd984421/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi Allure',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure',
 'vin': None,
 'year': 2020}
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878638%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [ayvens.be] INFO: Saving data for 1878638: {'created_time': 1769631064.017237, 'last_price_update_time': 1769631064.017246, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878638') HTTP/1.1" 204 0
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg not downloaded yet
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg not downloaded yet
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg not downloaded yet
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg not downloaded yet
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg not downloaded yet
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg not downloaded yet
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg not downloaded yet
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg not downloaded yet
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9750>
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/12.jpg saved to cache
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab410>
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg saved to cache
2026-01-28 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e60dd0>
2026-01-28 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/9.jpg saved to cache
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d20310>
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/11.jpg saved to cache
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:05 [ayvens.be] INFO: Found listing with ID: 1878641
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878641%27 HTTP/1.1" 200 None
2026-01-28 20:11:05 [ayvens.be] INFO: Scrape type for 1878641: 1
2026-01-28 20:11:05 [ayvens.be] INFO: Extracting data for car ID: 1878641
2026-01-28 20:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 452a844a-cc89-5771-85f1-5605f73f6597 with identifier: 1878641
2026-01-28 20:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452a844a-cc89-5771-85f1-5605f73f6597 with scrape type 1
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/1.jpg not downloaded yet
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52010>
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/15.jpg saved to cache
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48c10>
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/14.jpg saved to cache
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/2.jpg not downloaded yet
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/3.jpg not downloaded yet
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48fd0>
2026-01-28 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/8.jpg saved to cache
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efe550>
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/13.jpg saved to cache
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/4.jpg not downloaded yet
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/5.jpg not downloaded yet
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/6.jpg not downloaded yet
2026-01-28 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/7.jpg not downloaded yet
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/8.jpg not downloaded yet
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/9.jpg not downloaded yet
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e498d0>
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg saved to cache
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/10.jpg not downloaded yet
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9ed0>
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg saved to cache
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad98fdc10>
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg saved to cache
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/11.jpg not downloaded yet
2026-01-28 20:11:07 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 6 pages/min), scraped 38 items (at 3 items/min)
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/12.jpg not downloaded yet
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8fd10>
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg saved to cache
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37450>
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg saved to cache
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c01150>
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg saved to cache
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea3e90>
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg saved to cache
2026-01-28 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72850>
2026-01-28 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg saved to cache
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/13.jpg not downloaded yet
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/14.jpg not downloaded yet
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/15.jpg not downloaded yet
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/16.jpg not downloaded yet
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/17.jpg not downloaded yet
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/18.jpg not downloaded yet
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d948d0>
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg saved to cache
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/19.jpg not downloaded yet
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d95710>
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg saved to cache
2026-01-28 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91290>
2026-01-28 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg saved to cache
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:10 [ayvens.be] INFO: Found listing with ID: 1878642
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878642%27 HTTP/1.1" 200 None
2026-01-28 20:11:10 [ayvens.be] INFO: Scrape type for 1878642: 1
2026-01-28 20:11:10 [ayvens.be] INFO: Extracting data for car ID: 1878642
2026-01-28 20:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc963cf5-bc9c-5285-9bc0-902b4a3db158 with identifier: 1878642
2026-01-28 20:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc963cf5-bc9c-5285-9bc0-902b4a3db158 with scrape type 1
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/1.jpg not downloaded yet
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/2.jpg not downloaded yet
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7a50>
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fc03c50b0c34e40c3b55ddac51972f7c6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/10.jpg saved to cache
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8edf29be-3613-58a4-815d-3a4da6f0db13
2026-01-28 20:11:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8edf29be-3613-58a4-815d-3a4da6f0db13, skipping ID generation
2026-01-28 20:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8edf29be-3613-58a4-815d-3a4da6f0db13 with scrape type 1
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8edf29be-3613-58a4-815d-3a4da6f0db13 from tracking dictionaries
2026-01-28 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8edf29be-3613-58a4-815d-3a4da6f0db13 sending to next pipeline
2026-01-28 20:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8edf29be-3613-58a4-815d-3a4da6f0db13, identifier: 1878639
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de27d0>
2026-01-28 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg saved to cache
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e06d0>
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg saved to cache
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b1d0>
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg saved to cache
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e14510>
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg saved to cache
2026-01-28 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8edf29be-3613-58a4-815d-3a4da6f0db13 with identifier: 1878639
2026-01-28 20:11:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8edf29be-3613-58a4-815d-3a4da6f0db13 with identifier: 1878639
2026-01-28 20:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159290 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159290
2026-01-28 20:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8edf29be-3613-58a4-815d-3a4da6f0db13 spider: ayvens.be
2026-01-28 20:11:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8edf29be-3613-58a4-815d-3a4da6f0db13 due to rule: high_mileage_for_country.json, error: 159290 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159290
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'AQUAMARINE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '8edf29be-3613-58a4-815d-3a4da6f0db13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 159290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 753354,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771840,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618572,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548490,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8edf29be-3613-58a4-815d-3a4da6f0db13/8edf29be-3613-58a4-815d-3a4da6f0db13_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/c03c50b0c34e40c3b55ddac51972f7c6/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI SCR MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI SCR MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2022}
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878639%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [ayvens.be] INFO: Saving data for 1878639: {'created_time': 1769631072.147456, 'last_price_update_time': 1769631072.147465, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878639') HTTP/1.1" 204 0
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/3.jpg not downloaded yet
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/4.jpg not downloaded yet
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/5.jpg not downloaded yet
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/6.jpg not downloaded yet
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/7.jpg not downloaded yet
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/8.jpg not downloaded yet
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/9.jpg not downloaded yet
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15890>
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/2.jpg saved to cache
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd1ed0>
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/3.jpg saved to cache
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/10.jpg not downloaded yet
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15c50>
2026-01-28 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/5.jpg saved to cache
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/11.jpg not downloaded yet
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/12.jpg not downloaded yet
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df7910>
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/1.jpg saved to cache
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c46490>
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/4.jpg saved to cache
2026-01-28 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8d27390>
2026-01-28 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg saved to cache
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6f50>
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/10.jpg saved to cache
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1ad0>
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg saved to cache
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/13.jpg not downloaded yet
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/14.jpg not downloaded yet
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/15.jpg not downloaded yet
2026-01-28 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/16.jpg not downloaded yet
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/17.jpg not downloaded yet
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63f50>
2026-01-28 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/11.jpg saved to cache
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/18.jpg not downloaded yet
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33dd0>
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/13.jpg saved to cache
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccec90>
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/19.jpg saved to cache
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/19.jpg not downloaded yet
2026-01-28 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:15 [ayvens.be] INFO: Found listing with ID: 1878643
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878643%27 HTTP/1.1" 200 None
2026-01-28 20:11:15 [ayvens.be] INFO: Scrape type for 1878643: 1
2026-01-28 20:11:15 [ayvens.be] INFO: Extracting data for car ID: 1878643
2026-01-28 20:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec6636c-d754-5c6e-a543-15b4c324db91 with identifier: 1878643
2026-01-28 20:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec6636c-d754-5c6e-a543-15b4c324db91 with scrape type 1
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/1.jpg not downloaded yet
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b50910>
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/8.jpg saved to cache
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4dad0>
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/12.jpg saved to cache
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeb250>
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/18.jpg saved to cache
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edcf90>
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/7.jpg saved to cache
2026-01-28 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff3210>
2026-01-28 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/9.jpg saved to cache
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/2.jpg not downloaded yet
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/3.jpg not downloaded yet
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e274d0>
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/2.jpg saved to cache
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/4.jpg not downloaded yet
2026-01-28 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/5.jpg not downloaded yet
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/6.jpg not downloaded yet
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9a610>
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/1.jpg saved to cache
2026-01-28 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cccc50>
2026-01-28 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/3.jpg saved to cache
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f550>
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/4.jpg saved to cache
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74290>
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/16.jpg saved to cache
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/7.jpg not downloaded yet
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/8.jpg not downloaded yet
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42ed0>
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/17.jpg saved to cache
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37fd0>
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/15.jpg saved to cache
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd3690>
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/14.jpg saved to cache
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/9.jpg not downloaded yet
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/10.jpg not downloaded yet
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/11.jpg not downloaded yet
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/12.jpg not downloaded yet
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/13.jpg not downloaded yet
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3290>
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/13.jpg saved to cache
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/14.jpg not downloaded yet
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/15.jpg not downloaded yet
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/16.jpg not downloaded yet
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d950>
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/12.jpg saved to cache
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f31a50>
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/17.jpg saved to cache
2026-01-28 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d841d0>
2026-01-28 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/16.jpg saved to cache
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1d150>
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/11.jpg saved to cache
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c1d0>
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/15.jpg saved to cache
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3083790>
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/14.jpg saved to cache
2026-01-28 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f06050>
2026-01-28 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/18.jpg saved to cache
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/17.jpg not downloaded yet
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/18.jpg not downloaded yet
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/19.jpg not downloaded yet
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/20.jpg not downloaded yet
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [ayvens.be] INFO: Found listing with ID: 1878644
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878644%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [ayvens.be] INFO: Scrape type for 1878644: 1
2026-01-28 20:11:22 [ayvens.be] INFO: Extracting data for car ID: 1878644
2026-01-28 20:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed77930b-a163-5c0f-89d1-f4e761a891c2 with identifier: 1878644
2026-01-28 20:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77930b-a163-5c0f-89d1-f4e761a891c2 with scrape type 1
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/1.jpg not downloaded yet
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/2.jpg not downloaded yet
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/3.jpg not downloaded yet
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1ee90>
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/1.jpg saved to cache
2026-01-28 20:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50790>
2026-01-28 20:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/2.jpg saved to cache
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/4.jpg not downloaded yet
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e74590>
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/19.jpg saved to cache
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db63d0>
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/4.jpg saved to cache
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5e190>
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/3.jpg saved to cache
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/5.jpg not downloaded yet
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/6.jpg not downloaded yet
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e36d0>
2026-01-28 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/9.jpg saved to cache
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cadcd0>
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/10.jpg saved to cache
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8af4e50>
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/8.jpg saved to cache
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/7.jpg not downloaded yet
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/8.jpg not downloaded yet
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/9.jpg not downloaded yet
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/10.jpg not downloaded yet
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/11.jpg not downloaded yet
2026-01-28 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8d550>
2026-01-28 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/8.jpg saved to cache
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/12.jpg not downloaded yet
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/13.jpg not downloaded yet
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/14.jpg not downloaded yet
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6d10>
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/9.jpg saved to cache
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54b50>
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/7.jpg saved to cache
2026-01-28 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03b50>
2026-01-28 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/10.jpg saved to cache
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccd210>
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/5.jpg saved to cache
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30818d0>
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/6.jpg saved to cache
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35e90>
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/14.jpg saved to cache
2026-01-28 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27050>
2026-01-28 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/7.jpg saved to cache
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/15.jpg not downloaded yet
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/16.jpg not downloaded yet
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/17.jpg not downloaded yet
2026-01-28 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/18.jpg not downloaded yet
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/19.jpg not downloaded yet
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/20.jpg not downloaded yet
2026-01-28 20:11:27 [ayvens.be] INFO: Found listing with ID: 1878645
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878645%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [ayvens.be] INFO: Scrape type for 1878645: 1
2026-01-28 20:11:27 [ayvens.be] INFO: Extracting data for car ID: 1878645
2026-01-28 20:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e with identifier: 1878645
2026-01-28 20:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e with scrape type 1
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg not downloaded yet
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg not downloaded yet
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c658d0>
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/17.jpg saved to cache
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05dd0>
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/13.jpg saved to cache
2026-01-28 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f50210>
2026-01-28 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/15.jpg saved to cache
2026-01-28 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f53b50>
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/3.jpg saved to cache
2026-01-28 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51a50>
2026-01-28 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/4.jpg saved to cache
2026-01-28 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a5a590>
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/16.jpg saved to cache
2026-01-28 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc34d0>
2026-01-28 20:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/18.jpg saved to cache
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg not downloaded yet
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5d5d0>
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/2.jpg saved to cache
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg not downloaded yet
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg not downloaded yet
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg not downloaded yet
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg not downloaded yet
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg not downloaded yet
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d090>
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/6.jpg saved to cache
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg not downloaded yet
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg not downloaded yet
2026-01-28 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg not downloaded yet
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d221d0>
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/1.jpg saved to cache
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e56c90>
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/19.jpg saved to cache
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e56bd0>
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/5.jpg saved to cache
2026-01-28 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e45510>
2026-01-28 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/20.jpg saved to cache
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg not downloaded yet
2026-01-28 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg not downloaded yet
2026-01-28 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2d610>
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/12.jpg saved to cache
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d721d0>
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/7.jpg saved to cache
2026-01-28 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d950>
2026-01-28 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/8.jpg saved to cache
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg not downloaded yet
2026-01-28 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg not downloaded yet
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg not downloaded yet
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df5550>
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/15.jpg saved to cache
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c6dd0>
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/14.jpg saved to cache
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg not downloaded yet
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg not downloaded yet
2026-01-28 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e24590>
2026-01-28 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/13.jpg saved to cache
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b68d90>
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/16.jpg saved to cache
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ac10>
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/11.jpg saved to cache
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:34 [ayvens.be] INFO: Found listing with ID: 1878646
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878646%27 HTTP/1.1" 200 None
2026-01-28 20:11:34 [ayvens.be] INFO: Scrape type for 1878646: 1
2026-01-28 20:11:34 [ayvens.be] INFO: Extracting data for car ID: 1878646
2026-01-28 20:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12a7f50-52a8-5b77-98f5-2062af15527b with identifier: 1878646
2026-01-28 20:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12a7f50-52a8-5b77-98f5-2062af15527b with scrape type 1
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/1.jpg not downloaded yet
2026-01-28 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/2.jpg not downloaded yet
2026-01-28 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/3.jpg not downloaded yet
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0c2d0>
2026-01-28 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/10.jpg saved to cache
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30eab10>
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/9.jpg saved to cache
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/4.jpg not downloaded yet
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/5.jpg not downloaded yet
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25c90>
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/17.jpg saved to cache
2026-01-28 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e390>
2026-01-28 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg saved to cache
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27610>
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg saved to cache
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/6.jpg not downloaded yet
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/7.jpg not downloaded yet
2026-01-28 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/8.jpg not downloaded yet
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6ab10>
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg saved to cache
2026-01-28 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d153d0>
2026-01-28 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg saved to cache
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9410>
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg saved to cache
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/9.jpg not downloaded yet
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/10.jpg not downloaded yet
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea7150>
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg saved to cache
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/11.jpg not downloaded yet
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/12.jpg not downloaded yet
2026-01-28 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/13.jpg not downloaded yet
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6710>
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg saved to cache
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1cd0>
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg saved to cache
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e16990>
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg saved to cache
2026-01-28 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8a910>
2026-01-28 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg saved to cache
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/14.jpg not downloaded yet
2026-01-28 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/15.jpg not downloaded yet
2026-01-28 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbada1f5e50>
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg saved to cache
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6510>
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg saved to cache
2026-01-28 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99dd0>
2026-01-28 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg saved to cache
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:40 [ayvens.be] INFO: Found listing with ID: 1878647
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878647%27 HTTP/1.1" 200 None
2026-01-28 20:11:40 [ayvens.be] INFO: Scrape type for 1878647: 1
2026-01-28 20:11:40 [ayvens.be] INFO: Extracting data for car ID: 1878647
2026-01-28 20:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d41759-451c-5f0e-adec-7f31d3de2eb8 with identifier: 1878647
2026-01-28 20:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d41759-451c-5f0e-adec-7f31d3de2eb8 with scrape type 1
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg not downloaded yet
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg not downloaded yet
2026-01-28 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg not downloaded yet
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6990>
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg saved to cache
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6b710>
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg saved to cache
2026-01-28 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b13bd0>
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg saved to cache
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg not downloaded yet
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg not downloaded yet
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c51d0>
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/1.jpg saved to cache
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e98610>
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/3.jpg saved to cache
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg not downloaded yet
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg not downloaded yet
2026-01-28 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg not downloaded yet
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eabc50>
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg saved to cache
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8f50>
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/2.jpg saved to cache
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg not downloaded yet
2026-01-28 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg not downloaded yet
2026-01-28 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf2410>
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bc%252F8d4ba0adaa114399a55f3de8f399c1b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg saved to cache
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e
2026-01-28 20:11:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e, skipping ID generation
2026-01-28 20:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e with scrape type 1
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e from tracking dictionaries
2026-01-28 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e sending to next pipeline
2026-01-28 20:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e, identifier: 1878645
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1dd0>
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/8.jpg saved to cache
2026-01-28 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg not downloaded yet
2026-01-28 20:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e with identifier: 1878645
2026-01-28 20:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e with identifier: 1878645
2026-01-28 20:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 18, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'tiguan allspace', 'trim': '2.0 tdi comfortline', 'title': 'volkswagen tiguan allspace 2.0 tdi comfortline', 'price': 0, 'odometer': 200920, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 124, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0898963f-1b8f-5fa1-a3ce-64f9d3e0254e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603507}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 585731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 635805}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603196}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 682285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 720100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 812776}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 814654}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 622754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 621843}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 584912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 562259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 563534}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'volkswagen tiguan allspace', 'sanitized_make': 'volkswagen', 'odometer_in_km': 200920}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '0898963f-1b8f-5fa1-a3ce-64f9d3e0254e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen tiguan allspace',
     'model': 'tiguan allspace',
     'odometer': 200920,
     'odometer_in_km': 200920,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 18,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603507,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 585731,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 635805,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603196,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583112,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 682285,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 720100,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 812776,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 814654,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641077,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641331,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 622754,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 621843,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624440,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641605,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 584912,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 562259,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 563534,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-28',
     'sanitized_make': 'volkswagen',
     'seats_number': 7,
     'seller_name': None,
     'title': 'volkswagen tiguan allspace 2.0 tdi comfortline',
     'transmission': 'manual',
     'trim': '2.0 tdi comfortline',
     'vin': None,
     'year': 2021}
2026-01-28 20:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e spider: ayvens.be
2026-01-28 20:11:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0898963f-1b8f-5fa1-a3ce-64f9d3e0254e due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 18, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'tiguan allspace', 'trim': '2.0 tdi comfortline', 'title': 'volkswagen tiguan allspace 2.0 tdi comfortline', 'price': 0, 'odometer': 200920, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 124, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0898963f-1b8f-5fa1-a3ce-64f9d3e0254e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603507}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 585731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 635805}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603196}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 682285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 720100}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 812776}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 814654}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641331}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 622754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 621843}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 641605}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 584912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 562259}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 563534}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'volkswagen tiguan allspace', 'sanitized_make': 'volkswagen', 'odometer_in_km': 200920}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '0898963f-1b8f-5fa1-a3ce-64f9d3e0254e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen tiguan allspace',
     'model': 'tiguan allspace',
     'odometer': 200920,
     'odometer_in_km': 200920,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 18,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603507,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 585731,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 635805,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603196,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583112,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 682285,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 720100,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 812776,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 814654,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641077,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641331,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 622754,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 621843,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624440,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 641605,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 584912,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 562259,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 563534,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-28',
     'sanitized_make': 'volkswagen',
     'seats_number': 7,
     'seller_name': None,
     'title': 'volkswagen tiguan allspace 2.0 tdi comfortline',
     'transmission': 'manual',
     'trim': '2.0 tdi comfortline',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0898963f-1b8f-5fa1-a3ce-64f9d3e0254e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 200920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603196,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 812776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814654,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584912,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0898963f-1b8f-5fa1-a3ce-64f9d3e0254e/0898963f-1b8f-5fa1-a3ce-64f9d3e0254e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bc/8d4ba0adaa114399a55f3de8f399c1b2/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI COMFORTLINE',
 'transmission': 'manual',
 'trim': '2.0 TDI COMFORTLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878645%27 HTTP/1.1" 200 None
2026-01-28 20:11:43 [ayvens.be] INFO: Saving data for 1878645: {'created_time': 1769631103.754379, 'last_price_update_time': 1769631103.754388, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878645') HTTP/1.1" 204 0
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg not downloaded yet
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg not downloaded yet
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1350>
2026-01-28 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/7.jpg saved to cache
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2b10>
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/6.jpg saved to cache
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b401d0>
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/9.jpg saved to cache
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d50710>
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/5.jpg saved to cache
2026-01-28 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77fd0>
2026-01-28 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/10.jpg saved to cache
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e74b10>
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/4.jpg saved to cache
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg not downloaded yet
2026-01-28 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg not downloaded yet
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1110>
2026-01-28 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/12.jpg saved to cache
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [ayvens.be] INFO: Found listing with ID: 1878648
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878648%27 HTTP/1.1" 200 None
2026-01-28 20:11:46 [ayvens.be] INFO: Scrape type for 1878648: 1
2026-01-28 20:11:46 [ayvens.be] INFO: Extracting data for car ID: 1878648
2026-01-28 20:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099a631e-e185-5581-9e25-d9c9bd01f813 with identifier: 1878648
2026-01-28 20:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099a631e-e185-5581-9e25-d9c9bd01f813 with scrape type 1
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg not downloaded yet
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg not downloaded yet
2026-01-28 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg not downloaded yet
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9a10>
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/14.jpg saved to cache
2026-01-28 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8d550>
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/13.jpg saved to cache
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa350>
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg saved to cache
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da5f90>
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg saved to cache
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg not downloaded yet
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9b210>
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/11.jpg saved to cache
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9010>
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg saved to cache
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg not downloaded yet
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48110>
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ag%252Fc08f66329a204ceca46bd838bd9c23bc%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/15.jpg saved to cache
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c12a7f50-52a8-5b77-98f5-2062af15527b
2026-01-28 20:11:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c12a7f50-52a8-5b77-98f5-2062af15527b, skipping ID generation
2026-01-28 20:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12a7f50-52a8-5b77-98f5-2062af15527b with scrape type 1
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c12a7f50-52a8-5b77-98f5-2062af15527b from tracking dictionaries
2026-01-28 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c12a7f50-52a8-5b77-98f5-2062af15527b sending to next pipeline
2026-01-28 20:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c12a7f50-52a8-5b77-98f5-2062af15527b, identifier: 1878646
2026-01-28 20:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c12a7f50-52a8-5b77-98f5-2062af15527b with identifier: 1878646
2026-01-28 20:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c12a7f50-52a8-5b77-98f5-2062af15527b with identifier: 1878646
2026-01-28 20:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177271 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177271
2026-01-28 20:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c12a7f50-52a8-5b77-98f5-2062af15527b spider: ayvens.be
2026-01-28 20:11:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c12a7f50-52a8-5b77-98f5-2062af15527b due to rule: high_mileage_for_country.json, error: 177271 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177271
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c12a7f50-52a8-5b77-98f5-2062af15527b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 177271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524013,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c12a7f50-52a8-5b77-98f5-2062af15527b/c12a7f50-52a8-5b77-98f5-2062af15527b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ag/c08f66329a204ceca46bd838bd9c23bc/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 330E (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 330E (135KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878646%27 HTTP/1.1" 200 None
2026-01-28 20:11:49 [ayvens.be] INFO: Saving data for 1878646: {'created_time': 1769631109.162986, 'last_price_update_time': 1769631109.162996, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878646') HTTP/1.1" 204 0
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg not downloaded yet
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2caf150>
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg saved to cache
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg not downloaded yet
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg not downloaded yet
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg not downloaded yet
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cae7d0>
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg saved to cache
2026-01-28 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46a90>
2026-01-28 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg saved to cache
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg not downloaded yet
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg not downloaded yet
2026-01-28 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3250>
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/20.jpg saved to cache
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eda250>
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg saved to cache
2026-01-28 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3550>
2026-01-28 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg saved to cache
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78310>
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg saved to cache
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d7d0>
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg saved to cache
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg not downloaded yet
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg not downloaded yet
2026-01-28 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg not downloaded yet
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e1d0>
2026-01-28 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg saved to cache
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg not downloaded yet
2026-01-28 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg not downloaded yet
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1450>
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg saved to cache
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72a90>
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg saved to cache
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg not downloaded yet
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg not downloaded yet
2026-01-28 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg not downloaded yet
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15550>
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg saved to cache
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26fd0>
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F409d278492f24e2c9196094a83c3c659%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg saved to cache
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a7d41759-451c-5f0e-adec-7f31d3de2eb8
2026-01-28 20:11:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7d41759-451c-5f0e-adec-7f31d3de2eb8, skipping ID generation
2026-01-28 20:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d41759-451c-5f0e-adec-7f31d3de2eb8 with scrape type 1
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7d41759-451c-5f0e-adec-7f31d3de2eb8 from tracking dictionaries
2026-01-28 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7d41759-451c-5f0e-adec-7f31d3de2eb8 sending to next pipeline
2026-01-28 20:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a7d41759-451c-5f0e-adec-7f31d3de2eb8, identifier: 1878647
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd3b90>
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg saved to cache
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a7d41759-451c-5f0e-adec-7f31d3de2eb8 with identifier: 1878647
2026-01-28 20:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a7d41759-451c-5f0e-adec-7f31d3de2eb8 with identifier: 1878647
2026-01-28 20:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 15, 'seller_name': None, 'price_includes_vat': False, 'make': 'skoda', 'model': 'kodiaq', 'trim': '1.5 tsi 110kw ambition', 'title': 'skoda kodiaq 1.5 tsi 110kw ambition', 'price': 0, 'odometer': 209313, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-20', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a7d41759-451c-5f0e-adec-7f31d3de2eb8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 555589}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 577524}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 596002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 600149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 520336}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 564816}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 585295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 643774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 497385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 704384}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 707286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 645585}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'skoda kodiaq', 'sanitized_make': 'skoda', 'odometer_in_km': 209313}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'petrol',
     'id': 'a7d41759-451c-5f0e-adec-7f31d3de2eb8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'skoda',
     'make_model': 'skoda kodiaq',
     'model': 'kodiaq',
     'odometer': 209313,
     'odometer_in_km': 209313,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 15,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 555589,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 577524,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 596002,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 600149,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 520336,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 564816,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 585295,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 643774,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 497385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 476920,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 704384,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 488972,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 707286,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583437,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 645585,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-20',
     'sanitized_make': 'skoda',
     'seats_number': 5,
     'seller_name': None,
     'title': 'skoda kodiaq 1.5 tsi 110kw ambition',
     'transmission': 'manual',
     'trim': '1.5 tsi 110kw ambition',
     'vin': None,
     'year': 2020}
2026-01-28 20:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a7d41759-451c-5f0e-adec-7f31d3de2eb8 spider: ayvens.be
2026-01-28 20:11:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a7d41759-451c-5f0e-adec-7f31d3de2eb8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 15, 'seller_name': None, 'price_includes_vat': False, 'make': 'skoda', 'model': 'kodiaq', 'trim': '1.5 tsi 110kw ambition', 'title': 'skoda kodiaq 1.5 tsi 110kw ambition', 'price': 0, 'odometer': 209313, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-20', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a7d41759-451c-5f0e-adec-7f31d3de2eb8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 555589}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 577524}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 596002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 600149}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 520336}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 564816}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 585295}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 643774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 497385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476920}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 704384}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488972}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 707286}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 645585}], 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'skoda kodiaq', 'sanitized_make': 'skoda', 'odometer_in_km': 209313}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'petrol',
     'id': 'a7d41759-451c-5f0e-adec-7f31d3de2eb8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'skoda',
     'make_model': 'skoda kodiaq',
     'model': 'kodiaq',
     'odometer': 209313,
     'odometer_in_km': 209313,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 15,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 555589,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 577524,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 596002,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 600149,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 520336,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 564816,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 585295,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 643774,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 497385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 476920,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 704384,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 488972,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 707286,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583437,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 645585,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-20',
     'sanitized_make': 'skoda',
     'seats_number': 5,
     'seller_name': None,
     'title': 'skoda kodiaq 1.5 tsi 110kw ambition',
     'transmission': 'manual',
     'trim': '1.5 tsi 110kw ambition',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a7d41759-451c-5f0e-adec-7f31d3de2eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KODIAQ',
 'odometer': 209313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 488972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707286,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d41759-451c-5f0e-adec-7f31d3de2eb8/a7d41759-451c-5f0e-adec-7f31d3de2eb8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/409d278492f24e2c9196094a83c3c659/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KODIAQ 1.5 TSI 110KW AMBITION',
 'transmission': 'manual',
 'trim': '1.5 TSI 110KW AMBITION',
 'vin': None,
 'year': 2020}
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878647%27 HTTP/1.1" 200 None
2026-01-28 20:11:54 [ayvens.be] INFO: Saving data for 1878647: {'created_time': 1769631114.26158, 'last_price_update_time': 1769631114.261592, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878647') HTTP/1.1" 204 0
2026-01-28 20:11:54 [ayvens.be] INFO: Found listing with ID: 1878649
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878649%27 HTTP/1.1" 200 None
2026-01-28 20:11:54 [ayvens.be] INFO: Scrape type for 1878649: 1
2026-01-28 20:11:54 [ayvens.be] INFO: Extracting data for car ID: 1878649
2026-01-28 20:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac with identifier: 1878649
2026-01-28 20:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac with scrape type 1
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/1.jpg not downloaded yet
2026-01-28 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/2.jpg not downloaded yet
2026-01-28 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42950>
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/18.jpg saved to cache
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4c690>
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg saved to cache
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/3.jpg not downloaded yet
2026-01-28 20:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/4.jpg not downloaded yet
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e09d0>
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg saved to cache
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2ded0>
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg saved to cache
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba950>
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg saved to cache
2026-01-28 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/5.jpg not downloaded yet
2026-01-28 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/6.jpg not downloaded yet
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcb090>
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg saved to cache
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/7.jpg not downloaded yet
2026-01-28 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/8.jpg not downloaded yet
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/9.jpg not downloaded yet
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f15290>
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fad6ceb4e7d24487dbe507364a83ff57e%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/19.jpg saved to cache
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ed77930b-a163-5c0f-89d1-f4e761a891c2
2026-01-28 20:11:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed77930b-a163-5c0f-89d1-f4e761a891c2, skipping ID generation
2026-01-28 20:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77930b-a163-5c0f-89d1-f4e761a891c2 with scrape type 1
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ed77930b-a163-5c0f-89d1-f4e761a891c2 from tracking dictionaries
2026-01-28 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed77930b-a163-5c0f-89d1-f4e761a891c2 sending to next pipeline
2026-01-28 20:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ed77930b-a163-5c0f-89d1-f4e761a891c2, identifier: 1878644
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5de10>
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/12.jpg saved to cache
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48750>
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg saved to cache
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ed77930b-a163-5c0f-89d1-f4e761a891c2 with identifier: 1878644
2026-01-28 20:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ed77930b-a163-5c0f-89d1-f4e761a891c2 with identifier: 1878644
2026-01-28 20:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193781 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    193781
2026-01-28 20:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ed77930b-a163-5c0f-89d1-f4e761a891c2 spider: ayvens.be
2026-01-28 20:11:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ed77930b-a163-5c0f-89d1-f4e761a891c2 due to rule: high_mileage_for_country.json, error: 193781 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    193781
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ed77930b-a163-5c0f-89d1-f4e761a891c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90',
 'odometer': 193781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704510,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 921261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 724176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 851806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674874,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed77930b-a163-5c0f-89d1-f4e761a891c2/ed77930b-a163-5c0f-89d1-f4e761a891c2_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/ad6ceb4e7d24487dbe507364a83ff57e/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 2.0 T8 AWD GEARTRONIC INSCRIPTION 7PL.',
 'transmission': 'automatic',
 'trim': '2.0 T8 AWD GEARTRONIC INSCRIPTION 7PL.',
 'vin': None,
 'year': 2020}
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878644%27 HTTP/1.1" 200 None
2026-01-28 20:11:57 [ayvens.be] INFO: Saving data for 1878644: {'created_time': 1769631117.551951, 'last_price_update_time': 1769631117.55196, 'auction_closing_time': 1770107400.0}
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878644') HTTP/1.1" 204 0
2026-01-28 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/10.jpg not downloaded yet
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/11.jpg not downloaded yet
2026-01-28 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cafe50>
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg saved to cache
2026-01-28 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c016d0>
2026-01-28 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg saved to cache
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3c10>
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg saved to cache
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/12.jpg not downloaded yet
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/13.jpg not downloaded yet
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd20d0>
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg saved to cache
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eba090>
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg saved to cache
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/14.jpg not downloaded yet
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/15.jpg not downloaded yet
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eb8450>
2026-01-28 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg saved to cache
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44850>
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg saved to cache
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/16.jpg not downloaded yet
2026-01-28 20:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/17.jpg not downloaded yet
2026-01-28 20:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/18.jpg not downloaded yet
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17cd0>
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg saved to cache
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52010>
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg saved to cache
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ca90>
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg saved to cache
2026-01-28 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c50d90>
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg saved to cache
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/19.jpg not downloaded yet
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/20.jpg not downloaded yet
2026-01-28 20:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59c10>
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/1.jpg saved to cache
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5ab50>
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/4.jpg saved to cache
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c5a650>
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/2.jpg saved to cache
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:01 [ayvens.be] INFO: Found listing with ID: 1878650
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878650%27 HTTP/1.1" 200 None
2026-01-28 20:12:01 [ayvens.be] INFO: Scrape type for 1878650: 1
2026-01-28 20:12:01 [ayvens.be] INFO: Extracting data for car ID: 1878650
2026-01-28 20:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dad9ad67-2d03-5ed2-8986-d168ac69dae7 with identifier: 1878650
2026-01-28 20:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad9ad67-2d03-5ed2-8986-d168ac69dae7 with scrape type 1
2026-01-28 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/1.jpg not downloaded yet
2026-01-28 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/2.jpg not downloaded yet
2026-01-28 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/3.jpg not downloaded yet
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ebb9d0>
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/3.jpg saved to cache
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eba010>
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/5.jpg saved to cache
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/4.jpg not downloaded yet
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e950>
2026-01-28 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/7.jpg saved to cache
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a950>
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/6.jpg saved to cache
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/5.jpg not downloaded yet
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0f310>
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bq%252Fca32e46d3bda4736a6c782838af1cbc8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg saved to cache
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 099a631e-e185-5581-9e25-d9c9bd01f813
2026-01-28 20:12:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 099a631e-e185-5581-9e25-d9c9bd01f813, skipping ID generation
2026-01-28 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099a631e-e185-5581-9e25-d9c9bd01f813 with scrape type 1
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 099a631e-e185-5581-9e25-d9c9bd01f813 from tracking dictionaries
2026-01-28 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 099a631e-e185-5581-9e25-d9c9bd01f813 sending to next pipeline
2026-01-28 20:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 099a631e-e185-5581-9e25-d9c9bd01f813, identifier: 1878648
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/6.jpg not downloaded yet
2026-01-28 20:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 099a631e-e185-5581-9e25-d9c9bd01f813 with identifier: 1878648
2026-01-28 20:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 099a631e-e185-5581-9e25-d9c9bd01f813 with identifier: 1878648
2026-01-28 20:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 19, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '1.5 bluehdi s&s eat8 allure pack', 'title': 'peugeot 3008 1.5 bluehdi s&s eat8 allure pack', 'price': 0, 'odometer': 205320, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-11', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 104, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '099a631e-e185-5581-9e25-d9c9bd01f813', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 539276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 479431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 532421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 749232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 617024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 839869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 894830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 588881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 579048}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 691245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 606567}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 639391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 637156}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 561525}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 632260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 568016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 634281}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 205320}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '099a631e-e185-5581-9e25-d9c9bd01f813',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 205320,
     'odometer_in_km': 205320,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 19,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 539276,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 479431,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 498728,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 532421,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 504412,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 749232,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 617024,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 839869,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 894830,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 588881,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 579048,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 691245,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 606567,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 639391,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 637156,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 561525,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 632260,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 568016,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 634281,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-02-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.5 bluehdi s&s eat8 allure pack',
     'transmission': 'automatic',
     'trim': '1.5 bluehdi s&s eat8 allure pack',
     'vin': None,
     'year': 2022}
2026-01-28 20:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 099a631e-e185-5581-9e25-d9c9bd01f813 spider: ayvens.be
2026-01-28 20:12:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 099a631e-e185-5581-9e25-d9c9bd01f813 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 19, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '1.5 bluehdi s&s eat8 allure pack', 'title': 'peugeot 3008 1.5 bluehdi s&s eat8 allure pack', 'price': 0, 'odometer': 205320, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-11', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 104, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '099a631e-e185-5581-9e25-d9c9bd01f813', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 539276}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 479431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 532421}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 749232}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 617024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 839869}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 894830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 588881}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 579048}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 691245}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 606567}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 639391}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 637156}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 561525}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 632260}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 568016}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 634281}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 205320}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 47,
     'auction_title': '',
     'c_o_2_emission_value': 104,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '099a631e-e185-5581-9e25-d9c9bd01f813',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 205320,
     'odometer_in_km': 205320,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 19,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 539276,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 479431,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 498728,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 532421,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 504412,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 749232,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 617024,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 839869,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 894830,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 588881,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 579048,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 691245,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 606567,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 639391,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 637156,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 561525,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 632260,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 568016,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 634281,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-02-11',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.5 bluehdi s&s eat8 allure pack',
     'transmission': 'automatic',
     'trim': '1.5 bluehdi s&s eat8 allure pack',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '099a631e-e185-5581-9e25-d9c9bd01f813',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 205320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539276,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479431,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532421,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617024,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 894830,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639391,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099a631e-e185-5581-9e25-d9c9bd01f813/099a631e-e185-5581-9e25-d9c9bd01f813_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bq/ca32e46d3bda4736a6c782838af1cbc8/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878648%27 HTTP/1.1" 200 None
2026-01-28 20:12:04 [ayvens.be] INFO: Saving data for 1878648: {'created_time': 1769631124.406422, 'last_price_update_time': 1769631124.406432, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878648') HTTP/1.1" 204 0
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/7.jpg not downloaded yet
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5f090>
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/9.jpg saved to cache
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/8.jpg not downloaded yet
2026-01-28 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/9.jpg not downloaded yet
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7bed0>
2026-01-28 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/11.jpg saved to cache
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec5c10>
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/10.jpg saved to cache
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1fc90>
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/8.jpg saved to cache
2026-01-28 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98050>
2026-01-28 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252F180fbfff76a54fb6bfbac19354338a5c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/11.jpg saved to cache
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6ec6636c-d754-5c6e-a543-15b4c324db91
2026-01-28 20:12:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ec6636c-d754-5c6e-a543-15b4c324db91, skipping ID generation
2026-01-28 20:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec6636c-d754-5c6e-a543-15b4c324db91 with scrape type 1
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6ec6636c-d754-5c6e-a543-15b4c324db91 from tracking dictionaries
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ec6636c-d754-5c6e-a543-15b4c324db91 sending to next pipeline
2026-01-28 20:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6ec6636c-d754-5c6e-a543-15b4c324db91, identifier: 1878643
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8cd0>
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/13.jpg saved to cache
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/10.jpg not downloaded yet
2026-01-28 20:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6ec6636c-d754-5c6e-a543-15b4c324db91 with identifier: 1878643
2026-01-28 20:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6ec6636c-d754-5c6e-a543-15b4c324db91 with identifier: 1878643
2026-01-28 20:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6ec6636c-d754-5c6e-a543-15b4c324db91 with identifier: 1878643 to the API
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '6ec6636c-d754-5c6e-a543-15b4c324db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 89463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555439,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516500,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663243,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525521,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620946,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685053,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504744,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565972,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ec6636c-d754-5c6e-a543-15b4c324db91/6ec6636c-d754-5c6e-a543-15b4c324db91_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/180fbfff76a54fb6bfbac19354338a5c/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 200 D BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878643%27 HTTP/1.1" 200 None
2026-01-28 20:12:06 [ayvens.be] INFO: Saving data for 1878643: {'created_time': 1769631126.988781, 'last_price_update_time': 1769631126.988796, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878643') HTTP/1.1" 204 0
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/11.jpg not downloaded yet
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/12.jpg not downloaded yet
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b922d0>
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/12.jpg saved to cache
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/13.jpg not downloaded yet
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/14.jpg not downloaded yet
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79990>
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/6.jpg saved to cache
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c784d0>
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/15.jpg saved to cache
2026-01-28 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/15.jpg not downloaded yet
2026-01-28 20:12:08 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 3 pages/min), scraped 39 items (at 1 items/min)
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/16.jpg not downloaded yet
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/17.jpg not downloaded yet
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6eb90>
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/19.jpg saved to cache
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9790>
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/16.jpg saved to cache
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60850>
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/17.jpg saved to cache
2026-01-28 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceb850>
2026-01-28 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/20.jpg saved to cache
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e763d0>
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/18.jpg saved to cache
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62b90>
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/2.jpg saved to cache
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/18.jpg not downloaded yet
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/19.jpg not downloaded yet
2026-01-28 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ebb190>
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F5968112fb7584af9b35d793b1a487316%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/14.jpg saved to cache
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac
2026-01-28 20:12:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac, skipping ID generation
2026-01-28 20:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac with scrape type 1
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac from tracking dictionaries
2026-01-28 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac sending to next pipeline
2026-01-28 20:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac, identifier: 1878649
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b51990>
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/4.jpg saved to cache
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [ayvens.be] INFO: Found listing with ID: 1878651
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878651%27 HTTP/1.1" 200 None
2026-01-28 20:12:10 [ayvens.be] INFO: Scrape type for 1878651: 1
2026-01-28 20:12:10 [ayvens.be] INFO: Extracting data for car ID: 1878651
2026-01-28 20:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with identifier: 1878651
2026-01-28 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with scrape type 1
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/1.jpg not downloaded yet
2026-01-28 20:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac with identifier: 1878649
2026-01-28 20:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac with identifier: 1878649
2026-01-28 20:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145338 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145338
2026-01-28 20:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac spider: ayvens.be
2026-01-28 20:12:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac due to rule: high_mileage_for_country.json, error: 145338 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145338
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID5',
 'odometer': 145338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549149,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661858,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554893,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac/9e0d5e76-3c34-5fe4-b3bc-32f5cecaf8ac_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/5968112fb7584af9b35d793b1a487316/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID5 BEV 82KWH 150 KW PRO PERFORMANCE AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 150 KW PRO PERFORMANCE AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878649%27 HTTP/1.1" 200 None
2026-01-28 20:12:10 [ayvens.be] INFO: Saving data for 1878649: {'created_time': 1769631130.633412, 'last_price_update_time': 1769631130.633423, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878649') HTTP/1.1" 204 0
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/2.jpg not downloaded yet
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/3.jpg not downloaded yet
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc3910>
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/6.jpg saved to cache
2026-01-28 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99ed0>
2026-01-28 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/7.jpg saved to cache
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec61d0>
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/1.jpg saved to cache
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f33e50>
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/8.jpg saved to cache
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec7b90>
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/3.jpg saved to cache
2026-01-28 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48d10>
2026-01-28 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/9.jpg saved to cache
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/4.jpg not downloaded yet
2026-01-28 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/5.jpg not downloaded yet
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee8f90>
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/10.jpg saved to cache
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edff90>
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/5.jpg saved to cache
2026-01-28 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90410>
2026-01-28 20:12:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/12.jpg saved to cache
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/6.jpg not downloaded yet
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/7.jpg not downloaded yet
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/8.jpg not downloaded yet
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf13d0>
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/11.jpg saved to cache
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8df50>
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/13.jpg saved to cache
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/9.jpg not downloaded yet
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25c50>
2026-01-28 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/15.jpg saved to cache
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/10.jpg not downloaded yet
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5ca90>
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F0eb80d8eba0b4e7eaefff2bc85e5c1f5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/5.jpg saved to cache
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc963cf5-bc9c-5285-9bc0-902b4a3db158
2026-01-28 20:12:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc963cf5-bc9c-5285-9bc0-902b4a3db158, skipping ID generation
2026-01-28 20:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc963cf5-bc9c-5285-9bc0-902b4a3db158 with scrape type 1
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bc963cf5-bc9c-5285-9bc0-902b4a3db158 from tracking dictionaries
2026-01-28 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc963cf5-bc9c-5285-9bc0-902b4a3db158 sending to next pipeline
2026-01-28 20:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bc963cf5-bc9c-5285-9bc0-902b4a3db158, identifier: 1878642
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0390>
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg saved to cache
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c02550>
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/17.jpg saved to cache
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30eaf10>
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/18.jpg saved to cache
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e455d0>
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F731dec4f445f4626be9e87c3fede12a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/6.jpg saved to cache
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 452a844a-cc89-5771-85f1-5605f73f6597
2026-01-28 20:12:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 452a844a-cc89-5771-85f1-5605f73f6597, skipping ID generation
2026-01-28 20:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452a844a-cc89-5771-85f1-5605f73f6597 with scrape type 1
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 452a844a-cc89-5771-85f1-5605f73f6597 from tracking dictionaries
2026-01-28 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 452a844a-cc89-5771-85f1-5605f73f6597 sending to next pipeline
2026-01-28 20:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 452a844a-cc89-5771-85f1-5605f73f6597, identifier: 1878641
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2050>
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/14.jpg saved to cache
2026-01-28 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96190>
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/16.jpg saved to cache
2026-01-28 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/11.jpg not downloaded yet
2026-01-28 20:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bc963cf5-bc9c-5285-9bc0-902b4a3db158 with identifier: 1878642
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bc963cf5-bc9c-5285-9bc0-902b4a3db158 with identifier: 1878642
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136040 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    136040
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bc963cf5-bc9c-5285-9bc0-902b4a3db158 spider: ayvens.be
2026-01-28 20:12:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: bc963cf5-bc9c-5285-9bc0-902b4a3db158 due to rule: high_mileage_for_country.json, error: 136040 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    136040
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'bc963cf5-bc9c-5285-9bc0-902b4a3db158',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 136040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518776,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 779058,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 961882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 964823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 966886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 965432,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 943393,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569870,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc963cf5-bc9c-5285-9bc0-902b4a3db158/bc963cf5-bc9c-5285-9bc0-902b4a3db158_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532075,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/0eb80d8eba0b4e7eaefff2bc85e5c1f5/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '2.0 A 180 D BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2021}
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878642%27 HTTP/1.1" 200 None
2026-01-28 20:12:16 [ayvens.be] INFO: Saving data for 1878642: {'created_time': 1769631136.804154, 'last_price_update_time': 1769631136.804164, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878642') HTTP/1.1" 204 0
2026-01-28 20:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 452a844a-cc89-5771-85f1-5605f73f6597 with identifier: 1878641
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 452a844a-cc89-5771-85f1-5605f73f6597 with identifier: 1878641
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184320 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    184320
2026-01-28 20:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 452a844a-cc89-5771-85f1-5605f73f6597 spider: ayvens.be
2026-01-28 20:12:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 452a844a-cc89-5771-85f1-5605f73f6597 due to rule: high_mileage_for_country.json, error: 184320 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    184320
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '452a844a-cc89-5771-85f1-5605f73f6597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Tiguan  EX POLICE',
 'odometer': 184320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494274,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618918,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 759213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594856,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452a844a-cc89-5771-85f1-5605f73f6597/452a844a-cc89-5771-85f1-5605f73f6597_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/731dec4f445f4626be9e87c3fede12a8/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Tiguan  EX POLICE 2.0 TDI 110KW COMFORTLINE 4WD  EX '
          'POLICE',
 'transmission': 'manual',
 'trim': '2.0 TDI 110KW COMFORTLINE 4WD  EX POLICE',
 'vin': None,
 'year': 2020}
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878641%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [ayvens.be] INFO: Saving data for 1878641: {'created_time': 1769631137.059118, 'last_price_update_time': 1769631137.059127, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878641') HTTP/1.1" 204 0
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/12.jpg not downloaded yet
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/13.jpg not downloaded yet
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/14.jpg not downloaded yet
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/15.jpg not downloaded yet
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/16.jpg not downloaded yet
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/17.jpg not downloaded yet
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/18.jpg not downloaded yet
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/19.jpg not downloaded yet
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082f90>
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252F1fcd8777d9d24f8eab2bf98774ee5863%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/19.jpg saved to cache
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item dad9ad67-2d03-5ed2-8986-d168ac69dae7
2026-01-28 20:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dad9ad67-2d03-5ed2-8986-d168ac69dae7, skipping ID generation
2026-01-28 20:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dad9ad67-2d03-5ed2-8986-d168ac69dae7 with scrape type 1
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dad9ad67-2d03-5ed2-8986-d168ac69dae7 from tracking dictionaries
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dad9ad67-2d03-5ed2-8986-d168ac69dae7 sending to next pipeline
2026-01-28 20:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dad9ad67-2d03-5ed2-8986-d168ac69dae7, identifier: 1878650
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/20.jpg not downloaded yet
2026-01-28 20:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dad9ad67-2d03-5ed2-8986-d168ac69dae7 with identifier: 1878650
2026-01-28 20:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dad9ad67-2d03-5ed2-8986-d168ac69dae7 with identifier: 1878650
2026-01-28 20:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dad9ad67-2d03-5ed2-8986-d168ac69dae7 with identifier: 1878650 to the API
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 54,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'dad9ad67-2d03-5ed2-8986-d168ac69dae7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 94729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258113,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377796,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245136,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dad9ad67-2d03-5ed2-8986-d168ac69dae7/dad9ad67-2d03-5ed2-8986-d168ac69dae7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/1fcd8777d9d24f8eab2bf98774ee5863/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878650%27 HTTP/1.1" 200 None
2026-01-28 20:12:18 [ayvens.be] INFO: Saving data for 1878650: {'created_time': 1769631138.078521, 'last_price_update_time': 1769631138.078532, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878650') HTTP/1.1" 204 0
2026-01-28 20:12:18 [ayvens.be] INFO: Found listing with ID: 1878652
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878652%27 HTTP/1.1" 200 None
2026-01-28 20:12:18 [ayvens.be] INFO: Scrape type for 1878652: 1
2026-01-28 20:12:18 [ayvens.be] INFO: Extracting data for car ID: 1878652
2026-01-28 20:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with identifier: 1878652
2026-01-28 20:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with scrape type 1
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/1.jpg not downloaded yet
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/2.jpg not downloaded yet
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cce610>
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/2.jpg saved to cache
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98f10>
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/1.jpg saved to cache
2026-01-28 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4c90>
2026-01-28 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/5.jpg saved to cache
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee8b50>
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/3.jpg saved to cache
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc41d0>
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/4.jpg saved to cache
2026-01-28 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f412d0>
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/6.jpg saved to cache
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/3.jpg not downloaded yet
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/4.jpg not downloaded yet
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/5.jpg not downloaded yet
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/6.jpg not downloaded yet
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/7.jpg not downloaded yet
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/8.jpg not downloaded yet
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/9.jpg not downloaded yet
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/10.jpg not downloaded yet
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cfe50>
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/7.jpg saved to cache
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d595d0>
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/13.jpg saved to cache
2026-01-28 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9aad0>
2026-01-28 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/11.jpg saved to cache
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/11.jpg not downloaded yet
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24290>
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/10.jpg saved to cache
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc3c10>
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/8.jpg saved to cache
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2850>
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/12.jpg saved to cache
2026-01-28 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/12.jpg not downloaded yet
2026-01-28 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/13.jpg not downloaded yet
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbc150>
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/9.jpg saved to cache
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff15d0>
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bw%252Fb69c1a0295bd4119880da3ee93f3f575%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg saved to cache
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 84189b38-db39-5a25-a86d-f30f6588febb
2026-01-28 20:12:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84189b38-db39-5a25-a86d-f30f6588febb, skipping ID generation
2026-01-28 20:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84189b38-db39-5a25-a86d-f30f6588febb with scrape type 1
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84189b38-db39-5a25-a86d-f30f6588febb from tracking dictionaries
2026-01-28 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84189b38-db39-5a25-a86d-f30f6588febb sending to next pipeline
2026-01-28 20:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84189b38-db39-5a25-a86d-f30f6588febb, identifier: 1878640
2026-01-28 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84189b38-db39-5a25-a86d-f30f6588febb with identifier: 1878640
2026-01-28 20:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84189b38-db39-5a25-a86d-f30f6588febb with identifier: 1878640
2026-01-28 20:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 21, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'glc', 'trim': '2.0 glc 300 de phev 4matic 4wd bus sol', 'title': 'mercedes-benz glc 2.0 glc 300 de phev 4matic 4wd bus sol', 'price': 0, 'odometer': 203255, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-20', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.9l', 'c_o_2_emission_value': 47, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '84189b38-db39-5a25-a86d-f30f6588febb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 613783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 580345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 575072}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 691073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 625988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 693774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 658665}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 606456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 474399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 600667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 676143}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 604446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 577221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 633106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 531385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 591872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683894}], 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'mercedes-benz glc', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 203255}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 47,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.9l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '84189b38-db39-5a25-a86d-f30f6588febb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz glc',
     'model': 'glc',
     'odometer': 203255,
     'odometer_in_km': 203255,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 21,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 613783,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 580345,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603561,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624842,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 575072,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 691073,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 625988,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 693774,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 658665,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 606456,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 474399,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 600667,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 676143,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683757,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 604446,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 577221,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 633106,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 531385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 591872,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683894,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-04-20',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 5,
     'seller_name': None,
     'title': 'mercedes-benz glc 2.0 glc 300 de phev 4matic 4wd bus sol',
     'transmission': 'automatic',
     'trim': '2.0 glc 300 de phev 4matic 4wd bus sol',
     'vin': None,
     'year': 2022}
2026-01-28 20:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 84189b38-db39-5a25-a86d-f30f6588febb spider: ayvens.be
2026-01-28 20:12:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 84189b38-db39-5a25-a86d-f30f6588febb due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 21, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'glc', 'trim': '2.0 glc 300 de phev 4matic 4wd bus sol', 'title': 'mercedes-benz glc 2.0 glc 300 de phev 4matic 4wd bus sol', 'price': 0, 'odometer': 203255, 'odometer_reading_unit': 'km', 'registration_date': '2022-04-20', 'year': 2022, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.9l', 'c_o_2_emission_value': 47, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '84189b38-db39-5a25-a86d-f30f6588febb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 613783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 580345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 603561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 575072}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 691073}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 625988}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 693774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 658665}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 606456}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 474399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 600667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 676143}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 604446}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 577221}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 633106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 531385}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 591872}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683894}], 'current_year_diff': 4, 'age_in_months': 45, 'make_model': 'mercedes-benz glc', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 203255}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 45,
     'auction_title': '',
     'c_o_2_emission_value': 47,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.9l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'diesel',
     'id': '84189b38-db39-5a25-a86d-f30f6588febb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz glc',
     'model': 'glc',
     'odometer': 203255,
     'odometer_in_km': 203255,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 21,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 613783,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 580345,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 603561,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624842,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 575072,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 691073,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 625988,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 693774,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 658665,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 606456,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 474399,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 600667,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 676143,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683757,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 604446,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 577221,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 633106,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 531385,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 591872,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683894,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-04-20',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 5,
     'seller_name': None,
     'title': 'mercedes-benz glc 2.0 glc 300 de phev 4matic 4wd bus sol',
     'transmission': 'automatic',
     'trim': '2.0 glc 300 de phev 4matic 4wd bus sol',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': 47,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '84189b38-db39-5a25-a86d-f30f6588febb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 203255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580345,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603561,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575072,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691073,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625988,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604446,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84189b38-db39-5a25-a86d-f30f6588febb/84189b38-db39-5a25-a86d-f30f6588febb_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bw/b69c1a0295bd4119880da3ee93f3f575/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE PHEV 4MATIC 4WD BUS SOL',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE PHEV 4MATIC 4WD BUS SOL',
 'vin': None,
 'year': 2022}
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878640%27 HTTP/1.1" 200 None
2026-01-28 20:12:23 [ayvens.be] INFO: Saving data for 1878640: {'created_time': 1769631143.026818, 'last_price_update_time': 1769631143.026846, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878640') HTTP/1.1" 204 0
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/14.jpg not downloaded yet
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/15.jpg not downloaded yet
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e77a10>
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/16.jpg saved to cache
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbe610>
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/14.jpg saved to cache
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/16.jpg not downloaded yet
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/17.jpg not downloaded yet
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51950>
2026-01-28 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/18.jpg saved to cache
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1a410>
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/17.jpg saved to cache
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecf4d0>
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/15.jpg saved to cache
2026-01-28 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2e50>
2026-01-28 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/20.jpg saved to cache
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/18.jpg not downloaded yet
2026-01-28 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:25 [ayvens.be] INFO: Found listing with ID: 1878653
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878653%27 HTTP/1.1" 200 None
2026-01-28 20:12:25 [ayvens.be] INFO: Scrape type for 1878653: 1
2026-01-28 20:12:25 [ayvens.be] INFO: Extracting data for car ID: 1878653
2026-01-28 20:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f386ade-42fb-5245-a3c9-7e3135004ffb with identifier: 1878653
2026-01-28 20:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f386ade-42fb-5245-a3c9-7e3135004ffb with scrape type 1
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/1.jpg not downloaded yet
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b40f10>
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/1.jpg saved to cache
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46a50>
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252F45ff237bf2c34eabbce4b5040da24845%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/19.jpg saved to cache
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea
2026-01-28 20:12:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea, skipping ID generation
2026-01-28 20:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with scrape type 1
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea from tracking dictionaries
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea sending to next pipeline
2026-01-28 20:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea, identifier: 1878651
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/2.jpg not downloaded yet
2026-01-28 20:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with identifier: 1878651
2026-01-28 20:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with identifier: 1878651
2026-01-28 20:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea with identifier: 1878651 to the API
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 92001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712646,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 729851,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554262,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564535,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575315,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631792,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611904,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea/e1359f5a-3cdc-5b6c-9011-2f3a8ffa4dea_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557793,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/45ff237bf2c34eabbce4b5040da24845/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878651%27 HTTP/1.1" 200 None
2026-01-28 20:12:26 [ayvens.be] INFO: Saving data for 1878651: {'created_time': 1769631146.364147, 'last_price_update_time': 1769631146.364157, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878651') HTTP/1.1" 204 0
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/3.jpg not downloaded yet
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/4.jpg not downloaded yet
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b33c50>
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/3.jpg saved to cache
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/5.jpg not downloaded yet
2026-01-28 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/6.jpg not downloaded yet
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7df10>
2026-01-28 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/4.jpg saved to cache
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4bf50>
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/2.jpg saved to cache
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f624d0>
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/9.jpg saved to cache
2026-01-28 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc8210>
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/11.jpg saved to cache
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc08d0>
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/10.jpg saved to cache
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/7.jpg not downloaded yet
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/8.jpg not downloaded yet
2026-01-28 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/9.jpg not downloaded yet
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6fed0>
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/7.jpg saved to cache
2026-01-28 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e77c10>
2026-01-28 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/8.jpg saved to cache
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/10.jpg not downloaded yet
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/11.jpg not downloaded yet
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9add0>
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/12.jpg saved to cache
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/12.jpg not downloaded yet
2026-01-28 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/13.jpg not downloaded yet
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/14.jpg not downloaded yet
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48e10>
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/14.jpg saved to cache
2026-01-28 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cccb50>
2026-01-28 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/16.jpg saved to cache
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40dd0>
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/15.jpg saved to cache
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61150>
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/17.jpg saved to cache
2026-01-28 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43510>
2026-01-28 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/13.jpg saved to cache
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/15.jpg not downloaded yet
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/16.jpg not downloaded yet
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8d2d0>
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/5.jpg saved to cache
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ac10>
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/6.jpg saved to cache
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:31 [ayvens.be] INFO: Found listing with ID: 1878654
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878654%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [ayvens.be] INFO: Scrape type for 1878654: 1
2026-01-28 20:12:31 [ayvens.be] INFO: Extracting data for car ID: 1878654
2026-01-28 20:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2836f5a-ccd9-56cc-ab58-cc63a1680512 with identifier: 1878654
2026-01-28 20:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2836f5a-ccd9-56cc-ab58-cc63a1680512 with scrape type 1
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/1.jpg not downloaded yet
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/2.jpg not downloaded yet
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/3.jpg not downloaded yet
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a110>
2026-01-28 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F375504659c85465bbc1160aa30ebaa0e%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/18.jpg saved to cache
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658
2026-01-28 20:12:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f95e8bcc-58f3-534c-b1dc-7dff0caf0658, skipping ID generation
2026-01-28 20:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with scrape type 1
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f95e8bcc-58f3-534c-b1dc-7dff0caf0658 from tracking dictionaries
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f95e8bcc-58f3-534c-b1dc-7dff0caf0658 sending to next pipeline
2026-01-28 20:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f95e8bcc-58f3-534c-b1dc-7dff0caf0658, identifier: 1878652
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1410>
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/2.jpg saved to cache
2026-01-28 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edf4d0>
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/5.jpg saved to cache
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29bd0>
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/6.jpg saved to cache
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with identifier: 1878652
2026-01-28 20:12:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with identifier: 1878652
2026-01-28 20:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f95e8bcc-58f3-534c-b1dc-7dff0caf0658 with identifier: 1878652 to the API
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'PHYTONICBLAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f95e8bcc-58f3-534c-b1dc-7dff0caf0658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 48632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736394,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661494,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672081,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 740392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523849,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619134,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f95e8bcc-58f3-534c-b1dc-7dff0caf0658/f95e8bcc-58f3-534c-b1dc-7dff0caf0658_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544036,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/375504659c85465bbc1160aa30ebaa0e/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (120KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (120KW) AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878652%27 HTTP/1.1" 200 None
2026-01-28 20:12:33 [ayvens.be] INFO: Saving data for 1878652: {'created_time': 1769631153.819604, 'last_price_update_time': 1769631153.819613, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878652') HTTP/1.1" 204 0
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/4.jpg not downloaded yet
2026-01-28 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/5.jpg not downloaded yet
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30807d0>
2026-01-28 20:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/7.jpg saved to cache
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cebb50>
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/1.jpg saved to cache
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99ad0>
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/3.jpg saved to cache
2026-01-28 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48810>
2026-01-28 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/4.jpg saved to cache
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/6.jpg not downloaded yet
2026-01-28 20:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/7.jpg not downloaded yet
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab610>
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/9.jpg saved to cache
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/8.jpg not downloaded yet
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9a610>
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/12.jpg saved to cache
2026-01-28 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6d9d0>
2026-01-28 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/8.jpg saved to cache
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5e190>
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/11.jpg saved to cache
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e16710>
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/15.jpg saved to cache
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97710>
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/13.jpg saved to cache
2026-01-28 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de59d0>
2026-01-28 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/14.jpg saved to cache
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eea890>
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/10.jpg saved to cache
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/9.jpg not downloaded yet
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/10.jpg not downloaded yet
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/11.jpg not downloaded yet
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/12.jpg not downloaded yet
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/13.jpg not downloaded yet
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/14.jpg not downloaded yet
2026-01-28 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/15.jpg not downloaded yet
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/16.jpg not downloaded yet
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/17.jpg not downloaded yet
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e49ad0>
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F58b11f7946e944c6b6f6347e350f37d1%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/16.jpg saved to cache
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9f386ade-42fb-5245-a3c9-7e3135004ffb
2026-01-28 20:12:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f386ade-42fb-5245-a3c9-7e3135004ffb, skipping ID generation
2026-01-28 20:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f386ade-42fb-5245-a3c9-7e3135004ffb with scrape type 1
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9f386ade-42fb-5245-a3c9-7e3135004ffb from tracking dictionaries
2026-01-28 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f386ade-42fb-5245-a3c9-7e3135004ffb sending to next pipeline
2026-01-28 20:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f386ade-42fb-5245-a3c9-7e3135004ffb, identifier: 1878653
2026-01-28 20:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f386ade-42fb-5245-a3c9-7e3135004ffb with identifier: 1878653
2026-01-28 20:12:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f386ade-42fb-5245-a3c9-7e3135004ffb with identifier: 1878653
2026-01-28 20:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9f386ade-42fb-5245-a3c9-7e3135004ffb with identifier: 1878653 to the API
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'MINERALGRAU METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9f386ade-42fb-5245-a3c9-7e3135004ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 34744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262642,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276181,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323612,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f386ade-42fb-5245-a3c9-7e3135004ffb/9f386ade-42fb-5245-a3c9-7e3135004ffb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 339701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/58b11f7946e944c6b6f6347e350f37d1/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878653%27 HTTP/1.1" 200 None
2026-01-28 20:12:38 [ayvens.be] INFO: Saving data for 1878653: {'created_time': 1769631158.540232, 'last_price_update_time': 1769631158.540242, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878653') HTTP/1.1" 204 0
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/18.jpg not downloaded yet
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/19.jpg not downloaded yet
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14410>
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/2.jpg saved to cache
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de2e50>
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/1.jpg saved to cache
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24cd0>
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/5.jpg saved to cache
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de1550>
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/3.jpg saved to cache
2026-01-28 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c390>
2026-01-28 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/4.jpg saved to cache
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26650>
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/6.jpg saved to cache
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/20.jpg not downloaded yet
2026-01-28 20:12:40 [ayvens.be] INFO: Found listing with ID: 1878655
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878655%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [ayvens.be] INFO: Scrape type for 1878655: 1
2026-01-28 20:12:40 [ayvens.be] INFO: Extracting data for car ID: 1878655
2026-01-28 20:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with identifier: 1878655
2026-01-28 20:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with scrape type 1
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/1.jpg not downloaded yet
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/2.jpg not downloaded yet
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/3.jpg not downloaded yet
2026-01-28 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/4.jpg not downloaded yet
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/5.jpg not downloaded yet
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/6.jpg not downloaded yet
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/7.jpg not downloaded yet
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/8.jpg not downloaded yet
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9050>
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/8.jpg saved to cache
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/9.jpg not downloaded yet
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efc310>
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/9.jpg saved to cache
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9bf90>
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/13.jpg saved to cache
2026-01-28 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f18050>
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/10.jpg saved to cache
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080850>
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/7.jpg saved to cache
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b338d0>
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/11.jpg saved to cache
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/10.jpg not downloaded yet
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d65b10>
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/12.jpg saved to cache
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/11.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/12.jpg not downloaded yet
2026-01-28 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/13.jpg not downloaded yet
2026-01-28 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/14.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/15.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/16.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/17.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/18.jpg not downloaded yet
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/19.jpg not downloaded yet
2026-01-28 20:12:43 [ayvens.be] INFO: Found listing with ID: 1878656
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878656%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [ayvens.be] INFO: Scrape type for 1878656: 1
2026-01-28 20:12:43 [ayvens.be] INFO: Extracting data for car ID: 1878656
2026-01-28 20:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with identifier: 1878656
2026-01-28 20:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with scrape type 1
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/1.jpg not downloaded yet
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c68690>
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/18.jpg saved to cache
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e58610>
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/14.jpg saved to cache
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/2.jpg not downloaded yet
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6b010>
2026-01-28 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/15.jpg saved to cache
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cadcd0>
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/17.jpg saved to cache
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/3.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/4.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/5.jpg not downloaded yet
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/6.jpg not downloaded yet
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/7.jpg not downloaded yet
2026-01-28 20:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/8.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/9.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/10.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/11.jpg not downloaded yet
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/12.jpg not downloaded yet
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff18d0>
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/7.jpg saved to cache
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0c690>
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/9.jpg saved to cache
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e478d0>
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/19.jpg saved to cache
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/13.jpg not downloaded yet
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cec990>
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/20.jpg saved to cache
2026-01-28 20:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cc8fd0>
2026-01-28 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/8.jpg saved to cache
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea21d0>
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/6.jpg saved to cache
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b11f90>
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/1.jpg saved to cache
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/14.jpg not downloaded yet
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/15.jpg not downloaded yet
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79690>
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aj%252F909a3f92e03c4a65860fa40a82752b89%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/16.jpg saved to cache
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b2836f5a-ccd9-56cc-ab58-cc63a1680512
2026-01-28 20:12:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2836f5a-ccd9-56cc-ab58-cc63a1680512, skipping ID generation
2026-01-28 20:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2836f5a-ccd9-56cc-ab58-cc63a1680512 with scrape type 1
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b2836f5a-ccd9-56cc-ab58-cc63a1680512 from tracking dictionaries
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2836f5a-ccd9-56cc-ab58-cc63a1680512 sending to next pipeline
2026-01-28 20:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b2836f5a-ccd9-56cc-ab58-cc63a1680512, identifier: 1878654
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b2836f5a-ccd9-56cc-ab58-cc63a1680512 with identifier: 1878654
2026-01-28 20:12:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b2836f5a-ccd9-56cc-ab58-cc63a1680512 with identifier: 1878654
2026-01-28 20:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b2836f5a-ccd9-56cc-ab58-cc63a1680512 with identifier: 1878654 to the API
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'BLACK MAGIC METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b2836f5a-ccd9-56cc-ab58-cc63a1680512',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 96720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535953,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612803,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727717,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590434,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668631,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493387,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2836f5a-ccd9-56cc-ab58-cc63a1680512/b2836f5a-ccd9-56cc-ab58-cc63a1680512_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649392,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aj/909a3f92e03c4a65860fa40a82752b89/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.4 TSI PHEV 150KW DSG STYLE',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG STYLE',
 'vin': None,
 'year': 2021}
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878654%27 HTTP/1.1" 200 None
2026-01-28 20:12:47 [ayvens.be] INFO: Saving data for 1878654: {'created_time': 1769631167.855498, 'last_price_update_time': 1769631167.855508, 'auction_closing_time': 1770107400.0}
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878654') HTTP/1.1" 204 0
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/16.jpg not downloaded yet
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/17.jpg not downloaded yet
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5b250>
2026-01-28 20:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/5.jpg saved to cache
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/18.jpg not downloaded yet
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/19.jpg not downloaded yet
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c686d0>
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/4.jpg saved to cache
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8b810>
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/13.jpg saved to cache
2026-01-28 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6ca10>
2026-01-28 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/10.jpg saved to cache
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99050>
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/12.jpg saved to cache
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6cc10>
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/3.jpg saved to cache
2026-01-28 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e15210>
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/11.jpg saved to cache
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6ca50>
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/2.jpg saved to cache
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/20.jpg not downloaded yet
2026-01-28 20:12:50 [ayvens.be] INFO: Found listing with ID: 1878657
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878657%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [ayvens.be] INFO: Scrape type for 1878657: 1
2026-01-28 20:12:50 [ayvens.be] INFO: Extracting data for car ID: 1878657
2026-01-28 20:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f26205d-272d-5f14-9b06-590472cbd54d with identifier: 1878657
2026-01-28 20:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f26205d-272d-5f14-9b06-590472cbd54d with scrape type 1
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/1.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/2.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/3.jpg not downloaded yet
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/4.jpg not downloaded yet
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/5.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/6.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/7.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/8.jpg not downloaded yet
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/9.jpg not downloaded yet
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48590>
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/3.jpg saved to cache
2026-01-28 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8f50>
2026-01-28 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/5.jpg saved to cache
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f15bd0>
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/4.jpg saved to cache
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/10.jpg not downloaded yet
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b110>
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/11.jpg saved to cache
2026-01-28 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4b10>
2026-01-28 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/13.jpg saved to cache
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efffd0>
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/2.jpg saved to cache
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b421d0>
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/10.jpg saved to cache
2026-01-28 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb9910>
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/12.jpg saved to cache
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/11.jpg not downloaded yet
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/12.jpg not downloaded yet
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/13.jpg not downloaded yet
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/14.jpg not downloaded yet
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/15.jpg not downloaded yet
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [ayvens.be] INFO: Found listing with ID: 1878658
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878658%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [ayvens.be] INFO: Scrape type for 1878658: 1
2026-01-28 20:12:53 [ayvens.be] INFO: Extracting data for car ID: 1878658
2026-01-28 20:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9137b85-7a35-58ec-8fe4-c8b708ae526a with identifier: 1878658
2026-01-28 20:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9137b85-7a35-58ec-8fe4-c8b708ae526a with scrape type 1
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/1.jpg not downloaded yet
2026-01-28 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/2.jpg not downloaded yet
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72ed0>
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/15.jpg saved to cache
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/3.jpg not downloaded yet
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/4.jpg not downloaded yet
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/5.jpg not downloaded yet
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3b50>
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/17.jpg saved to cache
2026-01-28 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaaad0>
2026-01-28 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/14.jpg saved to cache
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6f550>
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/7.jpg saved to cache
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c013d0>
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/16.jpg saved to cache
2026-01-28 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab3d0>
2026-01-28 20:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/9.jpg saved to cache
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e01d0>
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/6.jpg saved to cache
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d96250>
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/8.jpg saved to cache
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/6.jpg not downloaded yet
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/7.jpg not downloaded yet
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/8.jpg not downloaded yet
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/9.jpg not downloaded yet
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/10.jpg not downloaded yet
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/11.jpg not downloaded yet
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/12.jpg not downloaded yet
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/13.jpg not downloaded yet
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c3d0>
2026-01-28 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/19.jpg saved to cache
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc29d0>
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/10.jpg saved to cache
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/14.jpg not downloaded yet
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0c910>
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/20.jpg saved to cache
2026-01-28 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51b50>
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/1.jpg saved to cache
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51750>
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/2.jpg saved to cache
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e17dd0>
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/3.jpg saved to cache
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/15.jpg not downloaded yet
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1cd10>
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/9.jpg saved to cache
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1effb10>
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/8.jpg saved to cache
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/16.jpg not downloaded yet
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/17.jpg not downloaded yet
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/18.jpg not downloaded yet
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/19.jpg not downloaded yet
2026-01-28 20:12:58 [ayvens.be] INFO: Found listing with ID: 1878659
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878659%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [ayvens.be] INFO: Scrape type for 1878659: 1
2026-01-28 20:12:58 [ayvens.be] INFO: Extracting data for car ID: 1878659
2026-01-28 20:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3943db45-fc65-587a-b56f-be44ba36383a with identifier: 1878659
2026-01-28 20:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3943db45-fc65-587a-b56f-be44ba36383a with scrape type 1
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/1.jpg not downloaded yet
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/2.jpg not downloaded yet
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1f190>
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/13.jpg saved to cache
2026-01-28 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb7010>
2026-01-28 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/5.jpg saved to cache
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd3d0>
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/12.jpg saved to cache
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d67290>
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/4.jpg saved to cache
2026-01-28 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb51d0>
2026-01-28 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/7.jpg saved to cache
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82e10>
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/6.jpg saved to cache
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d67390>
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/11.jpg saved to cache
2026-01-28 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17290>
2026-01-28 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/6.jpg saved to cache
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/3.jpg not downloaded yet
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/4.jpg not downloaded yet
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/5.jpg not downloaded yet
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/6.jpg not downloaded yet
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/7.jpg not downloaded yet
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/8.jpg not downloaded yet
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/9.jpg not downloaded yet
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/10.jpg not downloaded yet
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c8d550>
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/1.jpg saved to cache
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/11.jpg not downloaded yet
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbada087cd0>
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/2.jpg saved to cache
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8cd0>
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/3.jpg saved to cache
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec8090>
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/15.jpg saved to cache
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/12.jpg not downloaded yet
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64f50>
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/13.jpg saved to cache
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3fc90>
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/14.jpg saved to cache
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1a3d0>
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/14.jpg saved to cache
2026-01-28 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2a110>
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/7.jpg saved to cache
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/13.jpg not downloaded yet
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/14.jpg not downloaded yet
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/15.jpg not downloaded yet
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/16.jpg not downloaded yet
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/17.jpg not downloaded yet
2026-01-28 20:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:04 [ayvens.be] INFO: Found listing with ID: 1878660
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878660%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [ayvens.be] INFO: Scrape type for 1878660: 1
2026-01-28 20:13:04 [ayvens.be] INFO: Extracting data for car ID: 1878660
2026-01-28 20:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59fd6894-4a8b-5923-9667-777c5c208f96 with identifier: 1878660
2026-01-28 20:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59fd6894-4a8b-5923-9667-777c5c208f96 with scrape type 1
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/1.jpg not downloaded yet
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/2.jpg not downloaded yet
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/3.jpg not downloaded yet
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65f50>
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/17.jpg saved to cache
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e93ed0>
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/15.jpg saved to cache
2026-01-28 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2a110>
2026-01-28 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/16.jpg saved to cache
2026-01-28 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbed10>
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/12.jpg saved to cache
2026-01-28 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/4.jpg not downloaded yet
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e89dd0>
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/11.jpg saved to cache
2026-01-28 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9190>
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/10.jpg saved to cache
2026-01-28 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded410>
2026-01-28 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/18.jpg saved to cache
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/5.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/6.jpg not downloaded yet
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03890>
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/9.jpg saved to cache
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/7.jpg not downloaded yet
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/8.jpg not downloaded yet
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/9.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/10.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/11.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/12.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/13.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/14.jpg not downloaded yet
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/15.jpg not downloaded yet
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cae5d0>
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/6.jpg saved to cache
2026-01-28 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1effe10>
2026-01-28 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/5.jpg saved to cache
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97450>
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/19.jpg saved to cache
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d956d0>
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/3.jpg saved to cache
2026-01-28 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28b10>
2026-01-28 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/4.jpg saved to cache
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58cd0>
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/1.jpg saved to cache
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/16.jpg not downloaded yet
2026-01-28 20:13:09 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -6 pages/min), scraped 44 items (at 5 items/min)
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfab10>
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/7.jpg saved to cache
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f04390>
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/2.jpg saved to cache
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:09 [ayvens.be] INFO: Found listing with ID: 1878661
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878661%27 HTTP/1.1" 200 None
2026-01-28 20:13:09 [ayvens.be] INFO: Scrape type for 1878661: 1
2026-01-28 20:13:09 [ayvens.be] INFO: Extracting data for car ID: 1878661
2026-01-28 20:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30ae0324-9535-5ca2-9247-d41b3f25ec2a with identifier: 1878661
2026-01-28 20:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a with scrape type 1
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg not downloaded yet
2026-01-28 20:13:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg not downloaded yet
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg not downloaded yet
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg not downloaded yet
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg not downloaded yet
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg not downloaded yet
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg not downloaded yet
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg not downloaded yet
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d590>
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/10.jpg saved to cache
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg not downloaded yet
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e51090>
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/12.jpg saved to cache
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg not downloaded yet
2026-01-28 20:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg not downloaded yet
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec7d90>
2026-01-28 20:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/14.jpg saved to cache
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea1bd0>
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/11.jpg saved to cache
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8d27350>
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/15.jpg saved to cache
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77210>
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/9.jpg saved to cache
2026-01-28 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61c50>
2026-01-28 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/13.jpg saved to cache
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63f50>
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/4.jpg saved to cache
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg not downloaded yet
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg not downloaded yet
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3fb10>
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/6.jpg saved to cache
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg not downloaded yet
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg not downloaded yet
2026-01-28 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg not downloaded yet
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6cd50>
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/5.jpg saved to cache
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86e50>
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/17.jpg saved to cache
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5d950>
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/7.jpg saved to cache
2026-01-28 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d854d0>
2026-01-28 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/3.jpg saved to cache
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66b50>
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/16.jpg saved to cache
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2c310>
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/2.jpg saved to cache
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg not downloaded yet
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg not downloaded yet
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f069d0>
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/1.jpg saved to cache
2026-01-28 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg not downloaded yet
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg not downloaded yet
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [ayvens.be] INFO: Found listing with ID: 1878662
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878662%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [ayvens.be] INFO: Scrape type for 1878662: 1
2026-01-28 20:13:15 [ayvens.be] INFO: Extracting data for car ID: 1878662
2026-01-28 20:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 with identifier: 1878662
2026-01-28 20:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 with scrape type 1
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/1.jpg not downloaded yet
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/2.jpg not downloaded yet
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/3.jpg not downloaded yet
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/4.jpg not downloaded yet
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6750>
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg saved to cache
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0ed0>
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg saved to cache
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/5.jpg not downloaded yet
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efc290>
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg saved to cache
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/6.jpg not downloaded yet
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/7.jpg not downloaded yet
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48950>
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/15.jpg saved to cache
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5650>
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/16.jpg saved to cache
2026-01-28 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5ad90>
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/14.jpg saved to cache
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eea9d0>
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/13.jpg saved to cache
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6c690>
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg saved to cache
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/8.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/9.jpg not downloaded yet
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/10.jpg not downloaded yet
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/11.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/12.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/13.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/14.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/15.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/16.jpg not downloaded yet
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/17.jpg not downloaded yet
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbfd90>
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg saved to cache
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e769d0>
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg saved to cache
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3810>
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg saved to cache
2026-01-28 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e53e90>
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg saved to cache
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a290>
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg saved to cache
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/18.jpg not downloaded yet
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2110>
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg saved to cache
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51510>
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg saved to cache
2026-01-28 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59850>
2026-01-28 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg saved to cache
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:20 [ayvens.be] INFO: Found listing with ID: 1878663
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878663%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [ayvens.be] INFO: Scrape type for 1878663: 1
2026-01-28 20:13:20 [ayvens.be] INFO: Extracting data for car ID: 1878663
2026-01-28 20:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 979154bb-69ed-5919-a499-13d85b2a1c89 with identifier: 1878663
2026-01-28 20:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979154bb-69ed-5919-a499-13d85b2a1c89 with scrape type 1
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/1.jpg not downloaded yet
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/2.jpg not downloaded yet
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/3.jpg not downloaded yet
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/4.jpg not downloaded yet
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/5.jpg not downloaded yet
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/6.jpg not downloaded yet
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/7.jpg not downloaded yet
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/8.jpg not downloaded yet
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/9.jpg not downloaded yet
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85310>
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/5.jpg saved to cache
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d704d0>
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg saved to cache
2026-01-28 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ea10>
2026-01-28 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg saved to cache
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d71fd0>
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg saved to cache
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/10.jpg not downloaded yet
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c310>
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg saved to cache
2026-01-28 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6910>
2026-01-28 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg saved to cache
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/11.jpg not downloaded yet
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/12.jpg not downloaded yet
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded150>
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/4.jpg saved to cache
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0190>
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg saved to cache
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/13.jpg not downloaded yet
2026-01-28 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/14.jpg not downloaded yet
2026-01-28 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/15.jpg not downloaded yet
2026-01-28 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5d50>
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/16.jpg saved to cache
2026-01-28 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70310>
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/18.jpg saved to cache
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa610>
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/17.jpg saved to cache
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d350>
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/6.jpg saved to cache
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/16.jpg not downloaded yet
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/17.jpg not downloaded yet
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5fd0>
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/9.jpg saved to cache
2026-01-28 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30e90>
2026-01-28 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/3.jpg saved to cache
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b311d0>
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/7.jpg saved to cache
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3910>
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/8.jpg saved to cache
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/18.jpg not downloaded yet
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/19.jpg not downloaded yet
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/20.jpg not downloaded yet
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [ayvens.be] INFO: Found listing with ID: 1878664
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878664%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [ayvens.be] INFO: Scrape type for 1878664: 1
2026-01-28 20:13:25 [ayvens.be] INFO: Extracting data for car ID: 1878664
2026-01-28 20:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25210115-732b-5ef9-b29e-72a73b685924 with identifier: 1878664
2026-01-28 20:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25210115-732b-5ef9-b29e-72a73b685924 with scrape type 1
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/1.jpg not downloaded yet
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/2.jpg not downloaded yet
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/3.jpg not downloaded yet
2026-01-28 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/4.jpg not downloaded yet
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27b50>
2026-01-28 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/2.jpg saved to cache
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5b710>
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/1.jpg saved to cache
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/5.jpg not downloaded yet
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57950>
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/15.jpg saved to cache
2026-01-28 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df4050>
2026-01-28 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/14.jpg saved to cache
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/6.jpg not downloaded yet
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/7.jpg not downloaded yet
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73e50>
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/10.jpg saved to cache
2026-01-28 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9210>
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/9.jpg saved to cache
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa890>
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/7.jpg saved to cache
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9190>
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/8.jpg saved to cache
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/8.jpg not downloaded yet
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/9.jpg not downloaded yet
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/10.jpg not downloaded yet
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/11.jpg not downloaded yet
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/12.jpg not downloaded yet
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/13.jpg not downloaded yet
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/14.jpg not downloaded yet
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/15.jpg not downloaded yet
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca7090>
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/12.jpg saved to cache
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/16.jpg not downloaded yet
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c6dd0>
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/6.jpg saved to cache
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf0310>
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/11.jpg saved to cache
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2750>
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/13.jpg saved to cache
2026-01-28 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080350>
2026-01-28 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/5.jpg saved to cache
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/17.jpg not downloaded yet
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/18.jpg not downloaded yet
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f526d0>
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/3.jpg saved to cache
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef7dd0>
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/14.jpg saved to cache
2026-01-28 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f41210>
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/4.jpg saved to cache
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/19.jpg not downloaded yet
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [ayvens.be] INFO: Found listing with ID: 1878665
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878665%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [ayvens.be] INFO: Scrape type for 1878665: 1
2026-01-28 20:13:31 [ayvens.be] INFO: Extracting data for car ID: 1878665
2026-01-28 20:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8504048-136a-5433-a5b0-10abf1ecd586 with identifier: 1878665
2026-01-28 20:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8504048-136a-5433-a5b0-10abf1ecd586 with scrape type 1
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/1.jpg not downloaded yet
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/2.jpg not downloaded yet
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/3.jpg not downloaded yet
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35610>
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/18.jpg saved to cache
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99b90>
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/17.jpg saved to cache
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/4.jpg not downloaded yet
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/5.jpg not downloaded yet
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e59910>
2026-01-28 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/3.jpg saved to cache
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c2d5d0>
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/19.jpg saved to cache
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6cd0>
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/5.jpg saved to cache
2026-01-28 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14250>
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/4.jpg saved to cache
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e88fd0>
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/16.jpg saved to cache
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecfc10>
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/15.jpg saved to cache
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/6.jpg not downloaded yet
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/7.jpg not downloaded yet
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/8.jpg not downloaded yet
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/9.jpg not downloaded yet
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/10.jpg not downloaded yet
2026-01-28 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/11.jpg not downloaded yet
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/12.jpg not downloaded yet
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/13.jpg not downloaded yet
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc2c90>
2026-01-28 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/7.jpg saved to cache
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66fd0>
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/16.jpg saved to cache
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69f50>
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/15.jpg saved to cache
2026-01-28 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c490>
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/6.jpg saved to cache
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/14.jpg not downloaded yet
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebaf10>
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/2.jpg saved to cache
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f60610>
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/1.jpg saved to cache
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c53b10>
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/14.jpg saved to cache
2026-01-28 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cadb10>
2026-01-28 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/8.jpg saved to cache
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/15.jpg not downloaded yet
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/16.jpg not downloaded yet
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/17.jpg not downloaded yet
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/18.jpg not downloaded yet
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/19.jpg not downloaded yet
2026-01-28 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/20.jpg not downloaded yet
2026-01-28 20:13:36 [ayvens.be] INFO: Found listing with ID: 1878666
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878666%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [ayvens.be] INFO: Scrape type for 1878666: 1
2026-01-28 20:13:36 [ayvens.be] INFO: Extracting data for car ID: 1878666
2026-01-28 20:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e4ee92-a0df-5963-97bf-43c8a16f13ab with identifier: 1878666
2026-01-28 20:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab with scrape type 1
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/1.jpg not downloaded yet
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/2.jpg not downloaded yet
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5a6d0>
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/19.jpg saved to cache
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/3.jpg not downloaded yet
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/4.jpg not downloaded yet
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/5.jpg not downloaded yet
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e17dd0>
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/11.jpg saved to cache
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8e10>
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/10.jpg saved to cache
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0d6d0>
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/13.jpg saved to cache
2026-01-28 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d20750>
2026-01-28 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/12.jpg saved to cache
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f610>
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/17.jpg saved to cache
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe4f50>
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/18.jpg saved to cache
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e14dd0>
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/1.jpg saved to cache
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/6.jpg not downloaded yet
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/7.jpg not downloaded yet
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/8.jpg not downloaded yet
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/9.jpg not downloaded yet
2026-01-28 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/10.jpg not downloaded yet
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/11.jpg not downloaded yet
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/12.jpg not downloaded yet
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c4910>
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/5.jpg saved to cache
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/13.jpg not downloaded yet
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/14.jpg not downloaded yet
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/15.jpg not downloaded yet
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df52d0>
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/2.jpg saved to cache
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46ad0>
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/3.jpg saved to cache
2026-01-28 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25d90>
2026-01-28 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/14.jpg saved to cache
2026-01-28 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2a50>
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/7.jpg saved to cache
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb650>
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/4.jpg saved to cache
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7f550>
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/6.jpg saved to cache
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22950>
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xk%252Fc4eddc08692147ca8ad3bf7c6a86f50f%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/9.jpg saved to cache
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25210115-732b-5ef9-b29e-72a73b685924
2026-01-28 20:13:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25210115-732b-5ef9-b29e-72a73b685924, skipping ID generation
2026-01-28 20:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25210115-732b-5ef9-b29e-72a73b685924 with scrape type 1
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 25210115-732b-5ef9-b29e-72a73b685924 from tracking dictionaries
2026-01-28 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25210115-732b-5ef9-b29e-72a73b685924 sending to next pipeline
2026-01-28 20:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 25210115-732b-5ef9-b29e-72a73b685924, identifier: 1878664
2026-01-28 20:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 25210115-732b-5ef9-b29e-72a73b685924 with identifier: 1878664
2026-01-28 20:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 25210115-732b-5ef9-b29e-72a73b685924 with identifier: 1878664
2026-01-28 20:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master 35 fou lwb hr dsl - 201' containing 'master'
2026-01-28 20:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 25210115-732b-5ef9-b29e-72a73b685924 spider: ayvens.be
2026-01-28 20:13:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 25210115-732b-5ef9-b29e-72a73b685924 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master 35 fou lwb hr dsl - 201' containing 'master'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '25210115-732b-5ef9-b29e-72a73b685924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MASTER 35 FOU LWB HR DSL - 201',
 'odometer': 191069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561841,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495583,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 888153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727638,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578526,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651372,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741975,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25210115-732b-5ef9-b29e-72a73b685924/25210115-732b-5ef9-b29e-72a73b685924_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 410729,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xk/c4eddc08692147ca8ad3bf7c6a86f50f/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT MASTER 35 FOU LWB HR DSL - 201 2.3 dCi 35 L3H2 Energy Bl '
          'Grand Confort',
 'transmission': 'manual',
 'trim': '2.3 dCi 35 L3H2 Energy Bl Grand Confort',
 'vin': None,
 'year': 2020}
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878664%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [ayvens.be] INFO: Saving data for 1878664: {'created_time': 1769631222.225863, 'last_price_update_time': 1769631222.225872, 'auction_closing_time': 1770107400.0}
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878664') HTTP/1.1" 204 0
2026-01-28 20:13:42 [ayvens.be] INFO: Found listing with ID: 1878667
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878667%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [ayvens.be] INFO: Scrape type for 1878667: 1
2026-01-28 20:13:42 [ayvens.be] INFO: Extracting data for car ID: 1878667
2026-01-28 20:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a726024a-70b2-5969-9136-93cb24a2e126 with identifier: 1878667
2026-01-28 20:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a726024a-70b2-5969-9136-93cb24a2e126 with scrape type 1
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/1.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/2.jpg not downloaded yet
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/3.jpg not downloaded yet
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/4.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/5.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/6.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/7.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/8.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/9.jpg not downloaded yet
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/10.jpg not downloaded yet
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1f990>
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/16.jpg saved to cache
2026-01-28 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de92d0>
2026-01-28 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/3.jpg saved to cache
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73b90>
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/2.jpg saved to cache
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0a90>
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/17.jpg saved to cache
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee86d0>
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/20.jpg saved to cache
2026-01-28 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/11.jpg not downloaded yet
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc7850>
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/13.jpg saved to cache
2026-01-28 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4890>
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/1.jpg saved to cache
2026-01-28 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eae050>
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/15.jpg saved to cache
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/12.jpg not downloaded yet
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/13.jpg not downloaded yet
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/14.jpg not downloaded yet
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/15.jpg not downloaded yet
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/16.jpg not downloaded yet
2026-01-28 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/17.jpg not downloaded yet
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/18.jpg not downloaded yet
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/19.jpg not downloaded yet
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f63890>
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/5.jpg saved to cache
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/20.jpg not downloaded yet
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8fa8350>
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/6.jpg saved to cache
2026-01-28 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d53b50>
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/15.jpg saved to cache
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c5690>
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/7.jpg saved to cache
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c79d0>
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/19.jpg saved to cache
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:13:46 [ayvens.be] INFO: Found listing with ID: 1878668
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878668%27 HTTP/1.1" 200 None
2026-01-28 20:13:46 [ayvens.be] INFO: Scrape type for 1878668: 1
2026-01-28 20:13:46 [ayvens.be] INFO: Extracting data for car ID: 1878668
2026-01-28 20:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with identifier: 1878668
2026-01-28 20:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with scrape type 1
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/1.jpg not downloaded yet
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/2.jpg not downloaded yet
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cc8890>
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/14.jpg saved to cache
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce93d0>
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/4.jpg saved to cache
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0a1d0>
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/1.jpg saved to cache
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/3.jpg not downloaded yet
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/4.jpg not downloaded yet
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/5.jpg not downloaded yet
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/6.jpg not downloaded yet
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/7.jpg not downloaded yet
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/8.jpg not downloaded yet
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/9.jpg not downloaded yet
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/10.jpg not downloaded yet
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d666d0>
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/13.jpg saved to cache
2026-01-28 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22e50>
2026-01-28 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/12.jpg saved to cache
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/11.jpg not downloaded yet
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee3490>
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/10.jpg saved to cache
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/12.jpg not downloaded yet
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd12d0>
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/11.jpg saved to cache
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e23250>
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/11.jpg saved to cache
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72350>
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/8.jpg saved to cache
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea7150>
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/7.jpg saved to cache
2026-01-28 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52650>
2026-01-28 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/9.jpg saved to cache
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/13.jpg not downloaded yet
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/14.jpg not downloaded yet
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/15.jpg not downloaded yet
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/16.jpg not downloaded yet
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/17.jpg not downloaded yet
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/18.jpg not downloaded yet
2026-01-28 20:13:50 [ayvens.be] INFO: Found listing with ID: 1878669
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878669%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [ayvens.be] INFO: Scrape type for 1878669: 1
2026-01-28 20:13:50 [ayvens.be] INFO: Extracting data for car ID: 1878669
2026-01-28 20:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ece87c29-e41a-5668-9026-527b9e2f09b2 with identifier: 1878669
2026-01-28 20:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece87c29-e41a-5668-9026-527b9e2f09b2 with scrape type 1
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/1.jpg not downloaded yet
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/2.jpg not downloaded yet
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/3.jpg not downloaded yet
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad97765d0>
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/5.jpg saved to cache
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d650>
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/12.jpg saved to cache
2026-01-28 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8de90>
2026-01-28 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/20.jpg saved to cache
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/4.jpg not downloaded yet
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c47550>
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/19.jpg saved to cache
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5cb10>
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/3.jpg saved to cache
2026-01-28 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54810>
2026-01-28 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/4.jpg saved to cache
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28710>
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/13.jpg saved to cache
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecfd90>
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/6.jpg saved to cache
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/5.jpg not downloaded yet
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/6.jpg not downloaded yet
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/7.jpg not downloaded yet
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/8.jpg not downloaded yet
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/9.jpg not downloaded yet
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/10.jpg not downloaded yet
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/11.jpg not downloaded yet
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/12.jpg not downloaded yet
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/13.jpg not downloaded yet
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efe590>
2026-01-28 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/1.jpg saved to cache
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb7f10>
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/2.jpg saved to cache
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fadd10>
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/4.jpg saved to cache
2026-01-28 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcddd0>
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/3.jpg saved to cache
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2f610>
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/18.jpg saved to cache
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fad350>
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/15.jpg saved to cache
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1efe9d0>
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/17.jpg saved to cache
2026-01-28 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8ac10>
2026-01-28 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/16.jpg saved to cache
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/14.jpg not downloaded yet
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/15.jpg not downloaded yet
2026-01-28 20:13:55 [ayvens.be] INFO: Found listing with ID: 1878670
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878670%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [ayvens.be] INFO: Scrape type for 1878670: 1
2026-01-28 20:13:55 [ayvens.be] INFO: Extracting data for car ID: 1878670
2026-01-28 20:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9827c4da-0748-5333-b2b3-4f86346f9dd6 with identifier: 1878670
2026-01-28 20:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9827c4da-0748-5333-b2b3-4f86346f9dd6 with scrape type 1
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/1.jpg not downloaded yet
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/2.jpg not downloaded yet
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8410>
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/18.jpg saved to cache
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/3.jpg not downloaded yet
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/4.jpg not downloaded yet
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/5.jpg not downloaded yet
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3cdd0>
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/12.jpg saved to cache
2026-01-28 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d490>
2026-01-28 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/13.jpg saved to cache
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/6.jpg not downloaded yet
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/7.jpg not downloaded yet
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc7090>
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/14.jpg saved to cache
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c510>
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/2.jpg saved to cache
2026-01-28 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d65a50>
2026-01-28 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/4.jpg saved to cache
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e310>
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/1.jpg saved to cache
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8c450>
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/3.jpg saved to cache
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/8.jpg not downloaded yet
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/9.jpg not downloaded yet
2026-01-28 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/10.jpg not downloaded yet
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed02d0>
2026-01-28 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/6.jpg saved to cache
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/11.jpg not downloaded yet
2026-01-28 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/12.jpg not downloaded yet
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8b2d0>
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/5.jpg saved to cache
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8d950>
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/12.jpg saved to cache
2026-01-28 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffab50>
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/14.jpg saved to cache
2026-01-28 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f177d0>
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/11.jpg saved to cache
2026-01-28 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe6210>
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/13.jpg saved to cache
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/13.jpg not downloaded yet
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/14.jpg not downloaded yet
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/15.jpg not downloaded yet
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35210>
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/10.jpg saved to cache
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3390>
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/7.jpg saved to cache
2026-01-28 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77610>
2026-01-28 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/9.jpg saved to cache
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:01 [ayvens.be] INFO: Found listing with ID: 1878671
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878671%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [ayvens.be] INFO: Scrape type for 1878671: 1
2026-01-28 20:14:01 [ayvens.be] INFO: Extracting data for car ID: 1878671
2026-01-28 20:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 with identifier: 1878671
2026-01-28 20:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 with scrape type 1
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/1.jpg not downloaded yet
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/2.jpg not downloaded yet
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/3.jpg not downloaded yet
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/4.jpg not downloaded yet
2026-01-28 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/5.jpg not downloaded yet
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/6.jpg not downloaded yet
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/7.jpg not downloaded yet
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/8.jpg not downloaded yet
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f80390>
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/2.jpg saved to cache
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b590>
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/16.jpg saved to cache
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/9.jpg not downloaded yet
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a790>
2026-01-28 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/1.jpg saved to cache
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbd550>
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/3.jpg saved to cache
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8890>
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/17.jpg saved to cache
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27b50>
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/15.jpg saved to cache
2026-01-28 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb53d0>
2026-01-28 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F968e2c2fbe8a4f7b8f34ec70e1b9666c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/8.jpg saved to cache
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ece87c29-e41a-5668-9026-527b9e2f09b2
2026-01-28 20:14:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ece87c29-e41a-5668-9026-527b9e2f09b2, skipping ID generation
2026-01-28 20:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece87c29-e41a-5668-9026-527b9e2f09b2 with scrape type 1
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ece87c29-e41a-5668-9026-527b9e2f09b2 from tracking dictionaries
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ece87c29-e41a-5668-9026-527b9e2f09b2 sending to next pipeline
2026-01-28 20:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ece87c29-e41a-5668-9026-527b9e2f09b2, identifier: 1878669
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dee8d0>
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/5.jpg saved to cache
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/10.jpg not downloaded yet
2026-01-28 20:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ece87c29-e41a-5668-9026-527b9e2f09b2 with identifier: 1878669
2026-01-28 20:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ece87c29-e41a-5668-9026-527b9e2f09b2 with identifier: 1878669
2026-01-28 20:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ece87c29-e41a-5668-9026-527b9e2f09b2 with identifier: 1878669 to the API
2026-01-28 20:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ece87c29-e41a-5668-9026-527b9e2f09b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 46774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680961,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587166,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642302,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558780,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ece87c29-e41a-5668-9026-527b9e2f09b2/ece87c29-e41a-5668-9026-527b9e2f09b2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/968e2c2fbe8a4f7b8f34ec70e1b9666c/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878669%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [ayvens.be] INFO: Saving data for 1878669: {'created_time': 1769631244.131174, 'last_price_update_time': 1769631244.131183, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878669') HTTP/1.1" 204 0
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/11.jpg not downloaded yet
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/12.jpg not downloaded yet
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/13.jpg not downloaded yet
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/14.jpg not downloaded yet
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/15.jpg not downloaded yet
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/16.jpg not downloaded yet
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/17.jpg not downloaded yet
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/18.jpg not downloaded yet
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1bc10>
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/10.jpg saved to cache
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/19.jpg not downloaded yet
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7cb10>
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/7.jpg saved to cache
2026-01-28 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c030d0>
2026-01-28 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/9.jpg saved to cache
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c02910>
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/15.jpg saved to cache
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36ad0>
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/8.jpg saved to cache
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeac10>
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/11.jpg saved to cache
2026-01-28 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37a90>
2026-01-28 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/6.jpg saved to cache
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7990>
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/4.jpg saved to cache
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/20.jpg not downloaded yet
2026-01-28 20:14:06 [ayvens.be] INFO: Found listing with ID: 1878672
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878672%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [ayvens.be] INFO: Scrape type for 1878672: 1
2026-01-28 20:14:06 [ayvens.be] INFO: Extracting data for car ID: 1878672
2026-01-28 20:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c with identifier: 1878672
2026-01-28 20:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c with scrape type 1
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/1.jpg not downloaded yet
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/2.jpg not downloaded yet
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/3.jpg not downloaded yet
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/4.jpg not downloaded yet
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/5.jpg not downloaded yet
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/6.jpg not downloaded yet
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/7.jpg not downloaded yet
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/8.jpg not downloaded yet
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef7dd0>
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/14.jpg saved to cache
2026-01-28 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb7a90>
2026-01-28 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/2.jpg saved to cache
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/9.jpg not downloaded yet
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8c450>
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/13.jpg saved to cache
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1910>
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/1.jpg saved to cache
2026-01-28 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f16190>
2026-01-28 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/4.jpg saved to cache
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b6bf90>
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/3.jpg saved to cache
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:08 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at 0 pages/min), scraped 45 items (at 1 items/min)
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/10.jpg not downloaded yet
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d850>
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/12.jpg saved to cache
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8ffd0>
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ww%252F953d8b4de1d745809038d2963ec24e86%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/15.jpg saved to cache
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9827c4da-0748-5333-b2b3-4f86346f9dd6
2026-01-28 20:14:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9827c4da-0748-5333-b2b3-4f86346f9dd6, skipping ID generation
2026-01-28 20:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9827c4da-0748-5333-b2b3-4f86346f9dd6 with scrape type 1
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9827c4da-0748-5333-b2b3-4f86346f9dd6 from tracking dictionaries
2026-01-28 20:14:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9827c4da-0748-5333-b2b3-4f86346f9dd6 sending to next pipeline
2026-01-28 20:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9827c4da-0748-5333-b2b3-4f86346f9dd6, identifier: 1878670
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/11.jpg not downloaded yet
2026-01-28 20:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9827c4da-0748-5333-b2b3-4f86346f9dd6 with identifier: 1878670
2026-01-28 20:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9827c4da-0748-5333-b2b3-4f86346f9dd6 with identifier: 1878670
2026-01-28 20:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9827c4da-0748-5333-b2b3-4f86346f9dd6 with identifier: 1878670 to the API
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9827c4da-0748-5333-b2b3-4f86346f9dd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'FABIA COMBI - 2018',
 'odometer': 102114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548837,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9827c4da-0748-5333-b2b3-4f86346f9dd6/9827c4da-0748-5333-b2b3-4f86346f9dd6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ww/953d8b4de1d745809038d2963ec24e86/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA FABIA COMBI - 2018 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': '1.0 TSI Ambition',
 'vin': None,
 'year': 2019}
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878670%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [ayvens.be] INFO: Saving data for 1878670: {'created_time': 1769631249.486276, 'last_price_update_time': 1769631249.486287, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878670') HTTP/1.1" 204 0
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/12.jpg not downloaded yet
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/13.jpg not downloaded yet
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/14.jpg not downloaded yet
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/15.jpg not downloaded yet
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/16.jpg not downloaded yet
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/17.jpg not downloaded yet
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/18.jpg not downloaded yet
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f34290>
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/5.jpg saved to cache
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e390>
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/10.jpg saved to cache
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/19.jpg not downloaded yet
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/20.jpg not downloaded yet
2026-01-28 20:14:10 [ayvens.be] INFO: Found listing with ID: 1878673
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878673%27 HTTP/1.1" 200 None
2026-01-28 20:14:10 [ayvens.be] INFO: Scrape type for 1878673: 1
2026-01-28 20:14:10 [ayvens.be] INFO: Extracting data for car ID: 1878673
2026-01-28 20:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1c304f-f934-5ed1-ad7b-8668f683c04d with identifier: 1878673
2026-01-28 20:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d with scrape type 1
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/1.jpg not downloaded yet
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17690>
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/7.jpg saved to cache
2026-01-28 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27c10>
2026-01-28 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/11.jpg saved to cache
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f16cd0>
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/12.jpg saved to cache
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebbf90>
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/9.jpg saved to cache
2026-01-28 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2fbd0>
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/6.jpg saved to cache
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f14910>
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/8.jpg saved to cache
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/2.jpg not downloaded yet
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/3.jpg not downloaded yet
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/4.jpg not downloaded yet
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/5.jpg not downloaded yet
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/6.jpg not downloaded yet
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/7.jpg not downloaded yet
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/8.jpg not downloaded yet
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cad550>
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/1.jpg saved to cache
2026-01-28 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43450>
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/19.jpg saved to cache
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43390>
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/2.jpg saved to cache
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/9.jpg not downloaded yet
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbed50>
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/3.jpg saved to cache
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/10.jpg not downloaded yet
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/11.jpg not downloaded yet
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e246d0>
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/20.jpg saved to cache
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e58790>
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/18.jpg saved to cache
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f165d0>
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/16.jpg saved to cache
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25a10>
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/17.jpg saved to cache
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/12.jpg not downloaded yet
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/13.jpg not downloaded yet
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/14.jpg not downloaded yet
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/15.jpg not downloaded yet
2026-01-28 20:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/16.jpg not downloaded yet
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/17.jpg not downloaded yet
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/18.jpg not downloaded yet
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/19.jpg not downloaded yet
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69d10>
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/13.jpg saved to cache
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3d690>
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/12.jpg saved to cache
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23210>
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/19.jpg saved to cache
2026-01-28 20:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3d810>
2026-01-28 20:14:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/18.jpg saved to cache
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/20.jpg not downloaded yet
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f60310>
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/11.jpg saved to cache
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a47b50>
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/17.jpg saved to cache
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:16 [ayvens.be] INFO: Found listing with ID: 1878674
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878674%27 HTTP/1.1" 200 None
2026-01-28 20:14:16 [ayvens.be] INFO: Scrape type for 1878674: 1
2026-01-28 20:14:16 [ayvens.be] INFO: Extracting data for car ID: 1878674
2026-01-28 20:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac23c508-6cd1-5890-9f2f-849a3cff5b24 with identifier: 1878674
2026-01-28 20:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac23c508-6cd1-5890-9f2f-849a3cff5b24 with scrape type 1
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/1.jpg not downloaded yet
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/2.jpg not downloaded yet
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66110>
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/9.jpg saved to cache
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6850>
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/10.jpg saved to cache
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/3.jpg not downloaded yet
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/4.jpg not downloaded yet
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/5.jpg not downloaded yet
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/6.jpg not downloaded yet
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/7.jpg not downloaded yet
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/8.jpg not downloaded yet
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/9.jpg not downloaded yet
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eebe50>
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/3.jpg saved to cache
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6bfd0>
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/1.jpg saved to cache
2026-01-28 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfab50>
2026-01-28 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/2.jpg saved to cache
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/10.jpg not downloaded yet
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2ddd0>
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/20.jpg saved to cache
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d890>
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/14.jpg saved to cache
2026-01-28 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29910>
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/15.jpg saved to cache
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4ad90>
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/8.jpg saved to cache
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f80a90>
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/16.jpg saved to cache
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/11.jpg not downloaded yet
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/12.jpg not downloaded yet
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/13.jpg not downloaded yet
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/14.jpg not downloaded yet
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [ayvens.be] INFO: Found listing with ID: 1878675
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878675%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [ayvens.be] INFO: Scrape type for 1878675: 1
2026-01-28 20:14:19 [ayvens.be] INFO: Extracting data for car ID: 1878675
2026-01-28 20:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1878675
2026-01-28 20:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/1.jpg not downloaded yet
2026-01-28 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/2.jpg not downloaded yet
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/3.jpg not downloaded yet
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/4.jpg not downloaded yet
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52250>
2026-01-28 20:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/10.jpg saved to cache
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/5.jpg not downloaded yet
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a450>
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/12.jpg saved to cache
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd1d0>
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/11.jpg saved to cache
2026-01-28 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e8cd0>
2026-01-28 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/13.jpg saved to cache
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/6.jpg not downloaded yet
2026-01-28 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/7.jpg not downloaded yet
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b104d0>
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/14.jpg saved to cache
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ced0>
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/9.jpg saved to cache
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d95050>
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/20.jpg saved to cache
2026-01-28 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7d910>
2026-01-28 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/8.jpg saved to cache
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/8.jpg not downloaded yet
2026-01-28 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/9.jpg not downloaded yet
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48bd0>
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/2.jpg saved to cache
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35890>
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/3.jpg saved to cache
2026-01-28 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4a510>
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/4.jpg saved to cache
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d71f90>
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/1.jpg saved to cache
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/10.jpg not downloaded yet
2026-01-28 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/11.jpg not downloaded yet
2026-01-28 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/12.jpg not downloaded yet
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5e750>
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/19.jpg saved to cache
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ff50>
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/18.jpg saved to cache
2026-01-28 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef1610>
2026-01-28 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/17.jpg saved to cache
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/13.jpg not downloaded yet
2026-01-28 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/14.jpg not downloaded yet
2026-01-28 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35c90>
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/16.jpg saved to cache
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef0c90>
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/12.jpg saved to cache
2026-01-28 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc08d0>
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/11.jpg saved to cache
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/15.jpg not downloaded yet
2026-01-28 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:25 [ayvens.be] INFO: Found listing with ID: 1878676
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878676%27 HTTP/1.1" 200 None
2026-01-28 20:14:25 [ayvens.be] INFO: Scrape type for 1878676: 1
2026-01-28 20:14:25 [ayvens.be] INFO: Extracting data for car ID: 1878676
2026-01-28 20:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4be632-0ea4-5822-bf4f-0edf4421da42 with identifier: 1878676
2026-01-28 20:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4be632-0ea4-5822-bf4f-0edf4421da42 with scrape type 1
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/1.jpg not downloaded yet
2026-01-28 20:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/2.jpg not downloaded yet
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9910>
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/10.jpg saved to cache
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8db10>
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/13.jpg saved to cache
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70b50>
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/9.jpg saved to cache
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/3.jpg not downloaded yet
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/4.jpg not downloaded yet
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7d410>
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/6.jpg saved to cache
2026-01-28 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23110>
2026-01-28 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/5.jpg saved to cache
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de4510>
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/4.jpg saved to cache
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df9490>
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/8.jpg saved to cache
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3e5d0>
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/1.jpg saved to cache
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/5.jpg not downloaded yet
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/6.jpg not downloaded yet
2026-01-28 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/7.jpg not downloaded yet
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8310>
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/2.jpg saved to cache
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d94110>
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/3.jpg saved to cache
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/8.jpg not downloaded yet
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e91210>
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/9.jpg saved to cache
2026-01-28 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5ed90>
2026-01-28 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/10.jpg saved to cache
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/9.jpg not downloaded yet
2026-01-28 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba210>
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/14.jpg saved to cache
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59d90>
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/7.jpg saved to cache
2026-01-28 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e34090>
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/8.jpg saved to cache
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e750>
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/11.jpg saved to cache
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73350>
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/7.jpg saved to cache
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbeb10>
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/12.jpg saved to cache
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/10.jpg not downloaded yet
2026-01-28 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/11.jpg not downloaded yet
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e23210>
2026-01-28 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/5.jpg saved to cache
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd550>
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F3fedfdd8d00f423f820e1544003d162d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/6.jpg saved to cache
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac23c508-6cd1-5890-9f2f-849a3cff5b24
2026-01-28 20:14:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac23c508-6cd1-5890-9f2f-849a3cff5b24, skipping ID generation
2026-01-28 20:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac23c508-6cd1-5890-9f2f-849a3cff5b24 with scrape type 1
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ac23c508-6cd1-5890-9f2f-849a3cff5b24 from tracking dictionaries
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac23c508-6cd1-5890-9f2f-849a3cff5b24 sending to next pipeline
2026-01-28 20:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ac23c508-6cd1-5890-9f2f-849a3cff5b24, identifier: 1878674
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c685d0>
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/14.jpg saved to cache
2026-01-28 20:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ac23c508-6cd1-5890-9f2f-849a3cff5b24 with identifier: 1878674
2026-01-28 20:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ac23c508-6cd1-5890-9f2f-849a3cff5b24 with identifier: 1878674
2026-01-28 20:14:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 125157 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125157
2026-01-28 20:14:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ac23c508-6cd1-5890-9f2f-849a3cff5b24 spider: ayvens.be
2026-01-28 20:14:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ac23c508-6cd1-5890-9f2f-849a3cff5b24 due to rule: high_mileage_for_country.json, error: 125157 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125157
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ac23c508-6cd1-5890-9f2f-849a3cff5b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 125157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237968,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257143,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248442,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231003,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201662,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac23c508-6cd1-5890-9f2f-849a3cff5b24/ac23c508-6cd1-5890-9f2f-849a3cff5b24_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 343781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/3fedfdd8d00f423f820e1544003d162d/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TFSI E 55 270KW S TR QUAT. 4WD SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TFSI E 55 270KW S TR QUAT. 4WD SPORT',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878674%27 HTTP/1.1" 200 None
2026-01-28 20:14:32 [ayvens.be] INFO: Saving data for 1878674: {'created_time': 1769631272.200642, 'last_price_update_time': 1769631272.200651, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878674') HTTP/1.1" 204 0
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/12.jpg not downloaded yet
2026-01-28 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/13.jpg not downloaded yet
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0e4d0>
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/13.jpg saved to cache
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/14.jpg not downloaded yet
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/15.jpg not downloaded yet
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26c50>
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/15.jpg saved to cache
2026-01-28 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1e2d0>
2026-01-28 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fd1ab0697ea1b499eb0a3b6704785fc55%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/15.jpg saved to cache
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f987ca01-5c91-5382-9e54-a5af158d6ca0
2026-01-28 20:14:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f987ca01-5c91-5382-9e54-a5af158d6ca0, skipping ID generation
2026-01-28 20:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f987ca01-5c91-5382-9e54-a5af158d6ca0 with scrape type 1
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f987ca01-5c91-5382-9e54-a5af158d6ca0 from tracking dictionaries
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f987ca01-5c91-5382-9e54-a5af158d6ca0 sending to next pipeline
2026-01-28 20:14:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f987ca01-5c91-5382-9e54-a5af158d6ca0, identifier: 1878675
2026-01-28 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1878675
2026-01-28 20:14:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1878675
2026-01-28 20:14:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f987ca01-5c91-5382-9e54-a5af158d6ca0 with identifier: 1878675 to the API
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:14:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f987ca01-5c91-5382-9e54-a5af158d6ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 118163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280112,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306506,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308833,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f987ca01-5c91-5382-9e54-a5af158d6ca0/f987ca01-5c91-5382-9e54-a5af158d6ca0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/d1ab0697ea1b499eb0a3b6704785fc55/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'transmission': 'automatic',
 'trim': '2.0 40 G-TRON S TRONIC ADVANCED BUS. ED. CNG',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878675%27 HTTP/1.1" 200 None
2026-01-28 20:14:33 [ayvens.be] INFO: Saving data for 1878675: {'created_time': 1769631273.641296, 'last_price_update_time': 1769631273.641306, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878675') HTTP/1.1" 204 0
2026-01-28 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/16.jpg not downloaded yet
2026-01-28 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/17.jpg not downloaded yet
2026-01-28 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb58d0>
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/1.jpg saved to cache
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5e990>
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/2.jpg saved to cache
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/18.jpg not downloaded yet
2026-01-28 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/19.jpg not downloaded yet
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1f5d0>
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/3.jpg saved to cache
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5b890>
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/7.jpg saved to cache
2026-01-28 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1ec10>
2026-01-28 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/4.jpg saved to cache
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:35 [ayvens.be] INFO: Found listing with ID: 1878677
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878677%27 HTTP/1.1" 200 None
2026-01-28 20:14:35 [ayvens.be] INFO: Scrape type for 1878677: 1
2026-01-28 20:14:35 [ayvens.be] INFO: Extracting data for car ID: 1878677
2026-01-28 20:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d0363d-93aa-5d28-b269-e027ba998cdd with identifier: 1878677
2026-01-28 20:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d0363d-93aa-5d28-b269-e027ba998cdd with scrape type 1
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/1.jpg not downloaded yet
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/2.jpg not downloaded yet
2026-01-28 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c67ed0>
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/6.jpg saved to cache
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcb450>
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/5.jpg saved to cache
2026-01-28 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5d810>
2026-01-28 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/6.jpg saved to cache
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/3.jpg not downloaded yet
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/4.jpg not downloaded yet
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/5.jpg not downloaded yet
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a5bb10>
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/7.jpg saved to cache
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/6.jpg not downloaded yet
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/7.jpg not downloaded yet
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edfe90>
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F4423873c06a94dd8bd2d8c0314d740ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/4.jpg saved to cache
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d
2026-01-28 20:14:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b1c304f-f934-5ed1-ad7b-8668f683c04d, skipping ID generation
2026-01-28 20:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d with scrape type 1
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2b1c304f-f934-5ed1-ad7b-8668f683c04d from tracking dictionaries
2026-01-28 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b1c304f-f934-5ed1-ad7b-8668f683c04d sending to next pipeline
2026-01-28 20:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b1c304f-f934-5ed1-ad7b-8668f683c04d, identifier: 1878673
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea4390>
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/8.jpg saved to cache
2026-01-28 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a593d0>
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/5.jpg saved to cache
2026-01-28 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/8.jpg not downloaded yet
2026-01-28 20:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b1c304f-f934-5ed1-ad7b-8668f683c04d with identifier: 1878673
2026-01-28 20:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b1c304f-f934-5ed1-ad7b-8668f683c04d with identifier: 1878673
2026-01-28 20:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b1c304f-f934-5ed1-ad7b-8668f683c04d with identifier: 1878673 to the API
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2b1c304f-f934-5ed1-ad7b-8668f683c04d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 60715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514723,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547163,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 769343,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592162,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1c304f-f934-5ed1-ad7b-8668f683c04d/2b1c304f-f934-5ed1-ad7b-8668f683c04d_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687338,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/4423873c06a94dd8bd2d8c0314d740ef/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 HYBRID DYNAMIC PLUS E-CVT',
 'transmission': 'automatic',
 'trim': '1.8 HYBRID DYNAMIC PLUS E-CVT',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878673%27 HTTP/1.1" 200 None
2026-01-28 20:14:38 [ayvens.be] INFO: Saving data for 1878673: {'created_time': 1769631278.060254, 'last_price_update_time': 1769631278.060265, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878673') HTTP/1.1" 204 0
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/9.jpg not downloaded yet
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/10.jpg not downloaded yet
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e070d0>
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/7.jpg saved to cache
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082e50>
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/10.jpg saved to cache
2026-01-28 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99050>
2026-01-28 20:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/11.jpg saved to cache
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05750>
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/9.jpg saved to cache
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/11.jpg not downloaded yet
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/12.jpg not downloaded yet
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/13.jpg not downloaded yet
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/14.jpg not downloaded yet
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/15.jpg not downloaded yet
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/16.jpg not downloaded yet
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/17.jpg not downloaded yet
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1c50>
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/15.jpg saved to cache
2026-01-28 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d227d0>
2026-01-28 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/14.jpg saved to cache
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/18.jpg not downloaded yet
2026-01-28 20:14:40 [ayvens.be] INFO: Found listing with ID: 1878678
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878678%27 HTTP/1.1" 200 None
2026-01-28 20:14:40 [ayvens.be] INFO: Scrape type for 1878678: 1
2026-01-28 20:14:40 [ayvens.be] INFO: Extracting data for car ID: 1878678
2026-01-28 20:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51969249-fbdd-5379-9c9d-1f67eb248eae with identifier: 1878678
2026-01-28 20:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51969249-fbdd-5379-9c9d-1f67eb248eae with scrape type 1
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/1.jpg not downloaded yet
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/2.jpg not downloaded yet
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccd6d0>
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/13.jpg saved to cache
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8dd0>
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/18.jpg saved to cache
2026-01-28 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43f10>
2026-01-28 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/6.jpg saved to cache
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8b450>
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/12.jpg saved to cache
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3e3d0>
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/17.jpg saved to cache
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e993d0>
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/16.jpg saved to cache
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/3.jpg not downloaded yet
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/4.jpg not downloaded yet
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/5.jpg not downloaded yet
2026-01-28 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/6.jpg not downloaded yet
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/7.jpg not downloaded yet
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/8.jpg not downloaded yet
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/9.jpg not downloaded yet
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/10.jpg not downloaded yet
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99990>
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Fbaa7962c10df457186be1c97fc36dd35%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/19.jpg saved to cache
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item eb4be632-0ea4-5822-bf4f-0edf4421da42
2026-01-28 20:14:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb4be632-0ea4-5822-bf4f-0edf4421da42, skipping ID generation
2026-01-28 20:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4be632-0ea4-5822-bf4f-0edf4421da42 with scrape type 1
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb4be632-0ea4-5822-bf4f-0edf4421da42 from tracking dictionaries
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb4be632-0ea4-5822-bf4f-0edf4421da42 sending to next pipeline
2026-01-28 20:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb4be632-0ea4-5822-bf4f-0edf4421da42, identifier: 1878676
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48290>
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/5.jpg saved to cache
2026-01-28 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65dd0>
2026-01-28 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/2.jpg saved to cache
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5fc50>
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/1.jpg saved to cache
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f19610>
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yn%252F0fda99983bc9420f9a5c66bc9efd034e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/4.jpg saved to cache
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c
2026-01-28 20:14:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c, skipping ID generation
2026-01-28 20:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c with scrape type 1
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c from tracking dictionaries
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e5949ac-626d-5128-a5cd-42acf0dbcc1c sending to next pipeline
2026-01-28 20:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c, identifier: 1878672
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/11.jpg not downloaded yet
2026-01-28 20:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb4be632-0ea4-5822-bf4f-0edf4421da42 with identifier: 1878676
2026-01-28 20:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb4be632-0ea4-5822-bf4f-0edf4421da42 with identifier: 1878676
2026-01-28 20:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb4be632-0ea4-5822-bf4f-0edf4421da42 with identifier: 1878676 to the API
2026-01-28 20:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'eb4be632-0ea4-5822-bf4f-0edf4421da42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MINI',
 'model': 'COUNTRYMAN',
 'odometer': 85227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693609,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702331,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586110,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 728902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705337,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 719209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 811199,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4be632-0ea4-5822-bf4f-0edf4421da42/eb4be632-0ea4-5822-bf4f-0edf4421da42_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499697,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/baa7962c10df457186be1c97fc36dd35/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI COUNTRYMAN 1.5 COOPER S E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '1.5 COOPER S E 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878676%27 HTTP/1.1" 200 None
2026-01-28 20:14:44 [ayvens.be] INFO: Saving data for 1878676: {'created_time': 1769631284.225123, 'last_price_update_time': 1769631284.225135, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878676') HTTP/1.1" 204 0
2026-01-28 20:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c with identifier: 1878672
2026-01-28 20:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c with identifier: 1878672
2026-01-28 20:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
2026-01-28 20:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c spider: ayvens.be
2026-01-28 20:14:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9e5949ac-626d-5128-a5cd-42acf0dbcc1c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9e5949ac-626d-5128-a5cd-42acf0dbcc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TRANSPORTER',
 'odometer': 112149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494484,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672816,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 921221,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675719,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613512,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590926,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e5949ac-626d-5128-a5cd-42acf0dbcc1c/9e5949ac-626d-5128-a5cd-42acf0dbcc1c_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yn/0fda99983bc9420f9a5c66bc9efd034e/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'VOLKSWAGEN TRANSPORTER 2.0CRTDI SCR 110KW BMT SWB 2.8T',
 'transmission': 'manual',
 'trim': '2.0CRTDI SCR 110KW BMT SWB 2.8T',
 'vin': None,
 'year': 2020}
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878672%27 HTTP/1.1" 200 None
2026-01-28 20:14:44 [ayvens.be] INFO: Saving data for 1878672: {'created_time': 1769631284.449539, 'last_price_update_time': 1769631284.449548, 'auction_closing_time': 1770107400.0}
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878672') HTTP/1.1" 204 0
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef7790>
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/3.jpg saved to cache
2026-01-28 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64310>
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/4.jpg saved to cache
2026-01-28 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/12.jpg not downloaded yet
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/13.jpg not downloaded yet
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3fa10>
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/5.jpg saved to cache
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/14.jpg not downloaded yet
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/15.jpg not downloaded yet
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/16.jpg not downloaded yet
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/17.jpg not downloaded yet
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/18.jpg not downloaded yet
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/19.jpg not downloaded yet
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/20.jpg not downloaded yet
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb4150>
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/10.jpg saved to cache
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:45 [ayvens.be] INFO: Found listing with ID: 1878679
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878679%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [ayvens.be] INFO: Scrape type for 1878679: 1
2026-01-28 20:14:45 [ayvens.be] INFO: Extracting data for car ID: 1878679
2026-01-28 20:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with identifier: 1878679
2026-01-28 20:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with scrape type 1
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/1.jpg not downloaded yet
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a45690>
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/16.jpg saved to cache
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/2.jpg not downloaded yet
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/3.jpg not downloaded yet
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20110>
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/17.jpg saved to cache
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2e50>
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/18.jpg saved to cache
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7050>
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/11.jpg saved to cache
2026-01-28 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51d10>
2026-01-28 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/9.jpg saved to cache
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe7310>
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/8.jpg saved to cache
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee7b90>
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/7.jpg saved to cache
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/4.jpg not downloaded yet
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/5.jpg not downloaded yet
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/6.jpg not downloaded yet
2026-01-28 20:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/7.jpg not downloaded yet
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/8.jpg not downloaded yet
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/9.jpg not downloaded yet
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/10.jpg not downloaded yet
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/11.jpg not downloaded yet
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea7a50>
2026-01-28 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/2.jpg saved to cache
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b2d0>
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/1.jpg saved to cache
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/12.jpg not downloaded yet
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d20050>
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/14.jpg saved to cache
2026-01-28 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48990>
2026-01-28 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/5.jpg saved to cache
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e24b90>
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/15.jpg saved to cache
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d49f90>
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/4.jpg saved to cache
2026-01-28 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a190>
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/3.jpg saved to cache
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/13.jpg not downloaded yet
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/14.jpg not downloaded yet
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1e9d0>
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/13.jpg saved to cache
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/15.jpg not downloaded yet
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/16.jpg not downloaded yet
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c01f50>
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/1.jpg saved to cache
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/17.jpg not downloaded yet
2026-01-28 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/18.jpg not downloaded yet
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/19.jpg not downloaded yet
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbc450>
2026-01-28 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/15.jpg saved to cache
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c76d0>
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/11.jpg saved to cache
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc56d0>
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/13.jpg saved to cache
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e010>
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/14.jpg saved to cache
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/20.jpg not downloaded yet
2026-01-28 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:52 [ayvens.be] INFO: Found listing with ID: 1878680
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878680%27 HTTP/1.1" 200 None
2026-01-28 20:14:52 [ayvens.be] INFO: Scrape type for 1878680: 1
2026-01-28 20:14:52 [ayvens.be] INFO: Extracting data for car ID: 1878680
2026-01-28 20:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd86031b-e6d1-5a11-9c70-124c34140def with identifier: 1878680
2026-01-28 20:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd86031b-e6d1-5a11-9c70-124c34140def with scrape type 1
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/1.jpg not downloaded yet
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c57d0>
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/20.jpg saved to cache
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0d650>
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/10.jpg saved to cache
2026-01-28 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64990>
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/12.jpg saved to cache
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/2.jpg not downloaded yet
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/3.jpg not downloaded yet
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeae90>
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/2.jpg saved to cache
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5fb90>
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/4.jpg saved to cache
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f424d0>
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/3.jpg saved to cache
2026-01-28 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/4.jpg not downloaded yet
2026-01-28 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/5.jpg not downloaded yet
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26990>
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/19.jpg saved to cache
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/6.jpg not downloaded yet
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/7.jpg not downloaded yet
2026-01-28 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/8.jpg not downloaded yet
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed2e50>
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/5.jpg saved to cache
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e499d0>
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/17.jpg saved to cache
2026-01-28 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbfe10>
2026-01-28 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/18.jpg saved to cache
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff0850>
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/16.jpg saved to cache
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/9.jpg not downloaded yet
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/10.jpg not downloaded yet
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a69cd0>
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/14.jpg saved to cache
2026-01-28 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3850>
2026-01-28 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/11.jpg saved to cache
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7e0d0>
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/12.jpg saved to cache
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/11.jpg not downloaded yet
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/12.jpg not downloaded yet
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/13.jpg not downloaded yet
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70910>
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/13.jpg saved to cache
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/14.jpg not downloaded yet
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/15.jpg not downloaded yet
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61090>
2026-01-28 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/16.jpg saved to cache
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe6110>
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/10.jpg saved to cache
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc2b10>
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/17.jpg saved to cache
2026-01-28 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f83a50>
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/15.jpg saved to cache
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7a50>
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/1.jpg saved to cache
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/16.jpg not downloaded yet
2026-01-28 20:14:58 [ayvens.be] INFO: Found listing with ID: 1878681
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878681%27 HTTP/1.1" 200 None
2026-01-28 20:14:58 [ayvens.be] INFO: Scrape type for 1878681: 1
2026-01-28 20:14:58 [ayvens.be] INFO: Extracting data for car ID: 1878681
2026-01-28 20:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91083791-7b4f-58ea-ad9a-48a14d1702ec with identifier: 1878681
2026-01-28 20:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91083791-7b4f-58ea-ad9a-48a14d1702ec with scrape type 1
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/1.jpg not downloaded yet
2026-01-28 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/2.jpg not downloaded yet
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36f90>
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/20.jpg saved to cache
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c4f10>
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/3.jpg saved to cache
2026-01-28 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5610>
2026-01-28 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/2.jpg saved to cache
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/3.jpg not downloaded yet
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/4.jpg not downloaded yet
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0fd0>
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/18.jpg saved to cache
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e16d50>
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/7.jpg saved to cache
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/5.jpg not downloaded yet
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/6.jpg not downloaded yet
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/7.jpg not downloaded yet
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe6dd0>
2026-01-28 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/9.jpg saved to cache
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7550>
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/6.jpg saved to cache
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0110>
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/8.jpg saved to cache
2026-01-28 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082350>
2026-01-28 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/5.jpg saved to cache
2026-01-28 20:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5790>
2026-01-28 20:15:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/10.jpg saved to cache
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/8.jpg not downloaded yet
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/9.jpg not downloaded yet
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ecf150>
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/8.jpg saved to cache
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/10.jpg not downloaded yet
2026-01-28 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/11.jpg not downloaded yet
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/12.jpg not downloaded yet
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c76d0>
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/9.jpg saved to cache
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e8b590>
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/19.jpg saved to cache
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcf250>
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/4.jpg saved to cache
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/13.jpg not downloaded yet
2026-01-28 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/14.jpg not downloaded yet
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8a50>
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/11.jpg saved to cache
2026-01-28 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30610>
2026-01-28 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/14.jpg saved to cache
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30ea010>
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/12.jpg saved to cache
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8290>
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/13.jpg saved to cache
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/15.jpg not downloaded yet
2026-01-28 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/16.jpg not downloaded yet
2026-01-28 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/17.jpg not downloaded yet
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57410>
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/15.jpg saved to cache
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab390>
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/7.jpg saved to cache
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/18.jpg not downloaded yet
2026-01-28 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/19.jpg not downloaded yet
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dce2d0>
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ye%252F0b85ffe02b6441f7b9dfc86990da0a07%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/16.jpg saved to cache
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cd86031b-e6d1-5a11-9c70-124c34140def
2026-01-28 20:15:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd86031b-e6d1-5a11-9c70-124c34140def, skipping ID generation
2026-01-28 20:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd86031b-e6d1-5a11-9c70-124c34140def with scrape type 1
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cd86031b-e6d1-5a11-9c70-124c34140def from tracking dictionaries
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd86031b-e6d1-5a11-9c70-124c34140def sending to next pipeline
2026-01-28 20:15:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: cd86031b-e6d1-5a11-9c70-124c34140def, identifier: 1878680
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b91890>
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/2.jpg saved to cache
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d490>
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/3.jpg saved to cache
2026-01-28 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0c7d0>
2026-01-28 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/1.jpg saved to cache
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/20.jpg not downloaded yet
2026-01-28 20:15:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: cd86031b-e6d1-5a11-9c70-124c34140def with identifier: 1878680
2026-01-28 20:15:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: cd86031b-e6d1-5a11-9c70-124c34140def with identifier: 1878680
2026-01-28 20:15:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 126791 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    126791
2026-01-28 20:15:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cd86031b-e6d1-5a11-9c70-124c34140def spider: ayvens.be
2026-01-28 20:15:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: cd86031b-e6d1-5a11-9c70-124c34140def due to rule: high_mileage_for_country.json, error: 126791 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    126791
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'cd86031b-e6d1-5a11-9c70-124c34140def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 126791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230480,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238326,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249875,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335966,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365237,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336008,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd86031b-e6d1-5a11-9c70-124c34140def/cd86031b-e6d1-5a11-9c70-124c34140def_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ye/0b85ffe02b6441f7b9dfc86990da0a07/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 D3 GEARTRONIC MOMENTUM PRO',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC MOMENTUM PRO',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878680%27 HTTP/1.1" 200 None
2026-01-28 20:15:07 [ayvens.be] INFO: Saving data for 1878680: {'created_time': 1769631307.396105, 'last_price_update_time': 1769631307.396114, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878680') HTTP/1.1" 204 0
2026-01-28 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:07 [ayvens.be] INFO: Found listing with ID: 1878682
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878682%27 HTTP/1.1" 200 None
2026-01-28 20:15:07 [ayvens.be] INFO: Scrape type for 1878682: 1
2026-01-28 20:15:07 [ayvens.be] INFO: Extracting data for car ID: 1878682
2026-01-28 20:15:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560e4e22-8099-5d2a-aa4c-61ba33304fab with identifier: 1878682
2026-01-28 20:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560e4e22-8099-5d2a-aa4c-61ba33304fab with scrape type 1
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/1.jpg not downloaded yet
2026-01-28 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/2.jpg not downloaded yet
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b6ab10>
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/9.jpg saved to cache
2026-01-28 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2e90>
2026-01-28 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252Fe0f97a4597054bef8aec36408a65d521%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/6.jpg saved to cache
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402
2026-01-28 20:15:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecc1f445-36aa-5b7b-8228-5e6a5cd08402, skipping ID generation
2026-01-28 20:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with scrape type 1
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ecc1f445-36aa-5b7b-8228-5e6a5cd08402 from tracking dictionaries
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecc1f445-36aa-5b7b-8228-5e6a5cd08402 sending to next pipeline
2026-01-28 20:15:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ecc1f445-36aa-5b7b-8228-5e6a5cd08402, identifier: 1878679
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1a90>
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/4.jpg saved to cache
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with identifier: 1878679
2026-01-28 20:15:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with identifier: 1878679
2026-01-28 20:15:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ecc1f445-36aa-5b7b-8228-5e6a5cd08402 with identifier: 1878679 to the API
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ecc1f445-36aa-5b7b-8228-5e6a5cd08402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 80672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531762,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 502300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478108,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 795465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 718929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867842,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 837580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496798,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc1f445-36aa-5b7b-8228-5e6a5cd08402/ecc1f445-36aa-5b7b-8228-5e6a5cd08402_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/e0f97a4597054bef8aec36408a65d521/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878679%27 HTTP/1.1" 200 None
2026-01-28 20:15:08 [ayvens.be] INFO: Saving data for 1878679: {'created_time': 1769631308.863491, 'last_price_update_time': 1769631308.8635, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878679') HTTP/1.1" 204 0
2026-01-28 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:08 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 1 pages/min), scraped 50 items (at 5 items/min)
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/3.jpg not downloaded yet
2026-01-28 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/4.jpg not downloaded yet
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6b1d0>
2026-01-28 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/7.jpg saved to cache
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0ee90>
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/6.jpg saved to cache
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/5.jpg not downloaded yet
2026-01-28 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/6.jpg not downloaded yet
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37a90>
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/8.jpg saved to cache
2026-01-28 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2c550>
2026-01-28 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/5.jpg saved to cache
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/7.jpg not downloaded yet
2026-01-28 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/8.jpg not downloaded yet
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b68250>
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/12.jpg saved to cache
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcdd50>
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/7.jpg saved to cache
2026-01-28 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d190>
2026-01-28 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/9.jpg saved to cache
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/9.jpg not downloaded yet
2026-01-28 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/10.jpg not downloaded yet
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/11.jpg not downloaded yet
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea8690>
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/8.jpg saved to cache
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e88510>
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/11.jpg saved to cache
2026-01-28 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcbed0>
2026-01-28 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/14.jpg saved to cache
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/12.jpg not downloaded yet
2026-01-28 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/13.jpg not downloaded yet
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbfc10>
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/15.jpg saved to cache
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72510>
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/16.jpg saved to cache
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/14.jpg not downloaded yet
2026-01-28 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/15.jpg not downloaded yet
2026-01-28 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/16.jpg not downloaded yet
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea91d0>
2026-01-28 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/17.jpg saved to cache
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/17.jpg not downloaded yet
2026-01-28 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/18.jpg not downloaded yet
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99c90>
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/18.jpg saved to cache
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6490>
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/13.jpg saved to cache
2026-01-28 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2a90>
2026-01-28 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/10.jpg saved to cache
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3250>
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/20.jpg saved to cache
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/19.jpg not downloaded yet
2026-01-28 20:15:14 [ayvens.be] INFO: Found listing with ID: 1878683
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878683%27 HTTP/1.1" 200 None
2026-01-28 20:15:14 [ayvens.be] INFO: Scrape type for 1878683: 1
2026-01-28 20:15:14 [ayvens.be] INFO: Extracting data for car ID: 1878683
2026-01-28 20:15:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b13aa3-3708-539c-ba1c-e63f69066eeb with identifier: 1878683
2026-01-28 20:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b13aa3-3708-539c-ba1c-e63f69066eeb with scrape type 1
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/1.jpg not downloaded yet
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/2.jpg not downloaded yet
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee1b50>
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/1.jpg saved to cache
2026-01-28 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59390>
2026-01-28 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F6e2ec041f42745d893e2e13e4092d3d0%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/19.jpg saved to cache
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 91083791-7b4f-58ea-ad9a-48a14d1702ec
2026-01-28 20:15:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91083791-7b4f-58ea-ad9a-48a14d1702ec, skipping ID generation
2026-01-28 20:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91083791-7b4f-58ea-ad9a-48a14d1702ec with scrape type 1
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 91083791-7b4f-58ea-ad9a-48a14d1702ec from tracking dictionaries
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91083791-7b4f-58ea-ad9a-48a14d1702ec sending to next pipeline
2026-01-28 20:15:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91083791-7b4f-58ea-ad9a-48a14d1702ec, identifier: 1878681
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f80210>
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/2.jpg saved to cache
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91083791-7b4f-58ea-ad9a-48a14d1702ec with identifier: 1878681
2026-01-28 20:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91083791-7b4f-58ea-ad9a-48a14d1702ec with identifier: 1878681
2026-01-28 20:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146127 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146127
2026-01-28 20:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 91083791-7b4f-58ea-ad9a-48a14d1702ec spider: ayvens.be
2026-01-28 20:15:15 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 91083791-7b4f-58ea-ad9a-48a14d1702ec due to rule: high_mileage_for_country.json, error: 146127 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146127
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '91083791-7b4f-58ea-ad9a-48a14d1702ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 SPORTBACK',
 'odometer': 146127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541295,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522316,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703530,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 786702,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646352,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 781777,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626336,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578275,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91083791-7b4f-58ea-ad9a-48a14d1702ec/91083791-7b4f-58ea-ad9a-48a14d1702ec_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540639,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/6e2ec041f42745d893e2e13e4092d3d0/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 SPORTBACK 2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUS.ED.ADV.',
 'vin': None,
 'year': 2021}
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878681%27 HTTP/1.1" 200 None
2026-01-28 20:15:15 [ayvens.be] INFO: Saving data for 1878681: {'created_time': 1769631315.793773, 'last_price_update_time': 1769631315.793782, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878681') HTTP/1.1" 204 0
2026-01-28 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/3.jpg not downloaded yet
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/4.jpg not downloaded yet
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9350>
2026-01-28 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/3.jpg saved to cache
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/5.jpg not downloaded yet
2026-01-28 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/6.jpg not downloaded yet
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6a950>
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/5.jpg saved to cache
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eba950>
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/4.jpg saved to cache
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/7.jpg not downloaded yet
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/8.jpg not downloaded yet
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2f150>
2026-01-28 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/9.jpg saved to cache
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef11d0>
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yh%252F64181587c6e84ee189888aaea4886dbb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/6.jpg saved to cache
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51969249-fbdd-5379-9c9d-1f67eb248eae
2026-01-28 20:15:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51969249-fbdd-5379-9c9d-1f67eb248eae, skipping ID generation
2026-01-28 20:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51969249-fbdd-5379-9c9d-1f67eb248eae with scrape type 1
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 51969249-fbdd-5379-9c9d-1f67eb248eae from tracking dictionaries
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51969249-fbdd-5379-9c9d-1f67eb248eae sending to next pipeline
2026-01-28 20:15:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 51969249-fbdd-5379-9c9d-1f67eb248eae, identifier: 1878678
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed8210>
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/7.jpg saved to cache
2026-01-28 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c2f810>
2026-01-28 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/6.jpg saved to cache
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee33d0>
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/8.jpg saved to cache
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/9.jpg not downloaded yet
2026-01-28 20:15:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 51969249-fbdd-5379-9c9d-1f67eb248eae with identifier: 1878678
2026-01-28 20:15:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 51969249-fbdd-5379-9c9d-1f67eb248eae with identifier: 1878678
2026-01-28 20:15:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 51969249-fbdd-5379-9c9d-1f67eb248eae with identifier: 1878678 to the API
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '51969249-fbdd-5379-9c9d-1f67eb248eae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 113067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641212,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 780596,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587415,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611015,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528475,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51969249-fbdd-5379-9c9d-1f67eb248eae/51969249-fbdd-5379-9c9d-1f67eb248eae_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yh/64181587c6e84ee189888aaea4886dbb/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878678%27 HTTP/1.1" 200 None
2026-01-28 20:15:18 [ayvens.be] INFO: Saving data for 1878678: {'created_time': 1769631318.901749, 'last_price_update_time': 1769631318.901761, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878678') HTTP/1.1" 204 0
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/10.jpg not downloaded yet
2026-01-28 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/11.jpg not downloaded yet
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/12.jpg not downloaded yet
2026-01-28 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/13.jpg not downloaded yet
2026-01-28 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/14.jpg not downloaded yet
2026-01-28 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/15.jpg not downloaded yet
2026-01-28 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/16.jpg not downloaded yet
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/17.jpg not downloaded yet
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2eb50>
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/11.jpg saved to cache
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0890>
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/12.jpg saved to cache
2026-01-28 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5f090>
2026-01-28 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/13.jpg saved to cache
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/18.jpg not downloaded yet
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c077d0>
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/14.jpg saved to cache
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded950>
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/15.jpg saved to cache
2026-01-28 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5850>
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/10.jpg saved to cache
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7da90>
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/16.jpg saved to cache
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2fed0>
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/19.jpg saved to cache
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/19.jpg not downloaded yet
2026-01-28 20:15:21 [ayvens.be] INFO: Found listing with ID: 1878684
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878684%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [ayvens.be] INFO: Scrape type for 1878684: 1
2026-01-28 20:15:21 [ayvens.be] INFO: Extracting data for car ID: 1878684
2026-01-28 20:15:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37385cb1-2da6-523f-8119-0be7f146819d with identifier: 1878684
2026-01-28 20:15:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37385cb1-2da6-523f-8119-0be7f146819d with scrape type 1
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/1.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/2.jpg not downloaded yet
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/3.jpg not downloaded yet
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/4.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/5.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/6.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/7.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/8.jpg not downloaded yet
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/9.jpg not downloaded yet
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edb6d0>
2026-01-28 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/18.jpg saved to cache
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52610>
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/6.jpg saved to cache
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd2150>
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/2.jpg saved to cache
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/10.jpg not downloaded yet
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ded0>
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/5.jpg saved to cache
2026-01-28 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64c50>
2026-01-28 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/1.jpg saved to cache
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64550>
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/4.jpg saved to cache
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eca090>
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xj%252F8786e60da1304380a717d8c62d52129a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/17.jpg saved to cache
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 560e4e22-8099-5d2a-aa4c-61ba33304fab
2026-01-28 20:15:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 560e4e22-8099-5d2a-aa4c-61ba33304fab, skipping ID generation
2026-01-28 20:15:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560e4e22-8099-5d2a-aa4c-61ba33304fab with scrape type 1
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 560e4e22-8099-5d2a-aa4c-61ba33304fab from tracking dictionaries
2026-01-28 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 560e4e22-8099-5d2a-aa4c-61ba33304fab sending to next pipeline
2026-01-28 20:15:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 560e4e22-8099-5d2a-aa4c-61ba33304fab, identifier: 1878682
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eaeed0>
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/3.jpg saved to cache
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/11.jpg not downloaded yet
2026-01-28 20:15:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 560e4e22-8099-5d2a-aa4c-61ba33304fab with identifier: 1878682
2026-01-28 20:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 560e4e22-8099-5d2a-aa4c-61ba33304fab with identifier: 1878682
2026-01-28 20:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178335 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    178335
2026-01-28 20:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 560e4e22-8099-5d2a-aa4c-61ba33304fab spider: ayvens.be
2026-01-28 20:15:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 560e4e22-8099-5d2a-aa4c-61ba33304fab due to rule: high_mileage_for_country.json, error: 178335 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    178335
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '560e4e22-8099-5d2a-aa4c-61ba33304fab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 DIESEL - 2020',
 'odometer': 178335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751999,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 742906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712790,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686886,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559215,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560e4e22-8099-5d2a-aa4c-61ba33304fab/560e4e22-8099-5d2a-aa4c-61ba33304fab_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 883082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xj/8786e60da1304380a717d8c62d52129a/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 DIESEL - 2020 35 TDi Business Edition S line S tr.',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S line S tr.',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878682%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [ayvens.be] INFO: Saving data for 1878682: {'created_time': 1769631324.544168, 'last_price_update_time': 1769631324.544178, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878682') HTTP/1.1" 204 0
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/12.jpg not downloaded yet
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/13.jpg not downloaded yet
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/14.jpg not downloaded yet
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/15.jpg not downloaded yet
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/16.jpg not downloaded yet
2026-01-28 20:15:24 [ayvens.be] INFO: Found listing with ID: 1878685
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878685%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [ayvens.be] INFO: Scrape type for 1878685: 1
2026-01-28 20:15:24 [ayvens.be] INFO: Extracting data for car ID: 1878685
2026-01-28 20:15:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13cee32c-4849-518c-85f4-914e02b3a3c7 with identifier: 1878685
2026-01-28 20:15:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cee32c-4849-518c-85f4-914e02b3a3c7 with scrape type 1
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/1.jpg not downloaded yet
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/2.jpg not downloaded yet
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c5810>
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/9.jpg saved to cache
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/3.jpg not downloaded yet
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61b50>
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/10.jpg saved to cache
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db72d0>
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/13.jpg saved to cache
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/4.jpg not downloaded yet
2026-01-28 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/5.jpg not downloaded yet
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40110>
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/12.jpg saved to cache
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a47c10>
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/18.jpg saved to cache
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eade90>
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/8.jpg saved to cache
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3f750>
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/11.jpg saved to cache
2026-01-28 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e16510>
2026-01-28 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/14.jpg saved to cache
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/6.jpg not downloaded yet
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/7.jpg not downloaded yet
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5aa10>
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/2.jpg saved to cache
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e89950>
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/1.jpg saved to cache
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/8.jpg not downloaded yet
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/9.jpg not downloaded yet
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/10.jpg not downloaded yet
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62510>
2026-01-28 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/8.jpg saved to cache
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2e50>
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/9.jpg saved to cache
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e047d0>
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/10.jpg saved to cache
2026-01-28 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e059d0>
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/19.jpg saved to cache
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63b50>
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/16.jpg saved to cache
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/11.jpg not downloaded yet
2026-01-28 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/12.jpg not downloaded yet
2026-01-28 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea5bd0>
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/17.jpg saved to cache
2026-01-28 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98350>
2026-01-28 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/12.jpg saved to cache
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/13.jpg not downloaded yet
2026-01-28 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/14.jpg not downloaded yet
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/15.jpg not downloaded yet
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7d550>
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/13.jpg saved to cache
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c5290>
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/11.jpg saved to cache
2026-01-28 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de9b10>
2026-01-28 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/3.jpg saved to cache
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87a50>
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/15.jpg saved to cache
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1c610>
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/16.jpg saved to cache
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:31 [ayvens.be] INFO: Found listing with ID: 1878686
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878686%27 HTTP/1.1" 200 None
2026-01-28 20:15:31 [ayvens.be] INFO: Scrape type for 1878686: 1
2026-01-28 20:15:31 [ayvens.be] INFO: Extracting data for car ID: 1878686
2026-01-28 20:15:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4c9955-9b9c-54bb-8158-0509926d66e2 with identifier: 1878686
2026-01-28 20:15:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4c9955-9b9c-54bb-8158-0509926d66e2 with scrape type 1
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/1.jpg not downloaded yet
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/2.jpg not downloaded yet
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e513d0>
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/4.jpg saved to cache
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/3.jpg not downloaded yet
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/4.jpg not downloaded yet
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/5.jpg not downloaded yet
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea93d0>
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/2.jpg saved to cache
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e810>
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/1.jpg saved to cache
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9dd0>
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/14.jpg saved to cache
2026-01-28 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/6.jpg not downloaded yet
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/7.jpg not downloaded yet
2026-01-28 20:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20f10>
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/6.jpg saved to cache
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1d590>
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/7.jpg saved to cache
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5fc50>
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/5.jpg saved to cache
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/8.jpg not downloaded yet
2026-01-28 20:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/9.jpg not downloaded yet
2026-01-28 20:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/10.jpg not downloaded yet
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea6c10>
2026-01-28 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/5.jpg saved to cache
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c69a10>
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/6.jpg saved to cache
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c6710>
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/4.jpg saved to cache
2026-01-28 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73750>
2026-01-28 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/10.jpg saved to cache
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/11.jpg not downloaded yet
2026-01-28 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/12.jpg not downloaded yet
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76b10>
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/7.jpg saved to cache
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52e50>
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/11.jpg saved to cache
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98290>
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/9.jpg saved to cache
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/13.jpg not downloaded yet
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/14.jpg not downloaded yet
2026-01-28 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/15.jpg not downloaded yet
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffb350>
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Faf9e3c73e86f4a7f97b512a2b9467931%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/3.jpg saved to cache
2026-01-28 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37385cb1-2da6-523f-8119-0be7f146819d
2026-01-28 20:15:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37385cb1-2da6-523f-8119-0be7f146819d, skipping ID generation
2026-01-28 20:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37385cb1-2da6-523f-8119-0be7f146819d with scrape type 1
2026-01-28 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 37385cb1-2da6-523f-8119-0be7f146819d from tracking dictionaries
2026-01-28 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37385cb1-2da6-523f-8119-0be7f146819d sending to next pipeline
2026-01-28 20:15:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37385cb1-2da6-523f-8119-0be7f146819d, identifier: 1878684
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2b390>
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/8.jpg saved to cache
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6ee50>
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/12.jpg saved to cache
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37385cb1-2da6-523f-8119-0be7f146819d with identifier: 1878684
2026-01-28 20:15:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37385cb1-2da6-523f-8119-0be7f146819d with identifier: 1878684
2026-01-28 20:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 129854 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129854
2026-01-28 20:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 37385cb1-2da6-523f-8119-0be7f146819d spider: ayvens.be
2026-01-28 20:15:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 37385cb1-2da6-523f-8119-0be7f146819d due to rule: high_mileage_for_country.json, error: 129854 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129854
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'CAVANSITBLAUW',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '37385cb1-2da6-523f-8119-0be7f146819d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLC DIESEL (X253) - 2019',
 'odometer': 129854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366834,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506755,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329823,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37385cb1-2da6-523f-8119-0be7f146819d/37385cb1-2da6-523f-8119-0be7f146819d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/af9e3c73e86f4a7f97b512a2b9467931/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLC DIESEL (X253) - 2019 GLC 200 d 4-Matic '
          'Business Solution',
 'transmission': 'automatic',
 'trim': 'GLC 200 d 4-Matic Business Solution',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878684%27 HTTP/1.1" 200 None
2026-01-28 20:15:37 [ayvens.be] INFO: Saving data for 1878684: {'created_time': 1769631337.562347, 'last_price_update_time': 1769631337.562359, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878684') HTTP/1.1" 204 0
2026-01-28 20:15:37 [ayvens.be] INFO: Found listing with ID: 1878687
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878687%27 HTTP/1.1" 200 None
2026-01-28 20:15:37 [ayvens.be] INFO: Scrape type for 1878687: 1
2026-01-28 20:15:37 [ayvens.be] INFO: Extracting data for car ID: 1878687
2026-01-28 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12138a8a-0342-5787-bd0f-503183394cd8 with identifier: 1878687
2026-01-28 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12138a8a-0342-5787-bd0f-503183394cd8 with scrape type 1
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/1.jpg not downloaded yet
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/2.jpg not downloaded yet
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e07b90>
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/15.jpg saved to cache
2026-01-28 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfa790>
2026-01-28 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/14.jpg saved to cache
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9150>
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yx%252F91238d392fc3481d839e006ac798e8df%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/13.jpg saved to cache
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 13cee32c-4849-518c-85f4-914e02b3a3c7
2026-01-28 20:15:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13cee32c-4849-518c-85f4-914e02b3a3c7, skipping ID generation
2026-01-28 20:15:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13cee32c-4849-518c-85f4-914e02b3a3c7 with scrape type 1
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13cee32c-4849-518c-85f4-914e02b3a3c7 from tracking dictionaries
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13cee32c-4849-518c-85f4-914e02b3a3c7 sending to next pipeline
2026-01-28 20:15:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 13cee32c-4849-518c-85f4-914e02b3a3c7, identifier: 1878685
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f35150>
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/2.jpg saved to cache
2026-01-28 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff2390>
2026-01-28 20:15:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/1.jpg saved to cache
2026-01-28 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfb890>
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/5.jpg saved to cache
2026-01-28 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/3.jpg not downloaded yet
2026-01-28 20:15:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 13cee32c-4849-518c-85f4-914e02b3a3c7 with identifier: 1878685
2026-01-28 20:15:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 13cee32c-4849-518c-85f4-914e02b3a3c7 with identifier: 1878685
2026-01-28 20:15:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 13cee32c-4849-518c-85f4-914e02b3a3c7 with identifier: 1878685 to the API
2026-01-28 20:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '13cee32c-4849-518c-85f4-914e02b3a3c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 BERLINE',
 'odometer': 98581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651450,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688098,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689488,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511065,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596857,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13cee32c-4849-518c-85f4-914e02b3a3c7/13cee32c-4849-518c-85f4-914e02b3a3c7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645534,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yx/91238d392fc3481d839e006ac798e8df/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 BERLINE 2.0 TDI 30 85KW',
 'transmission': 'manual',
 'trim': '2.0 TDI 30 85KW',
 'vin': None,
 'year': 2021}
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878685%27 HTTP/1.1" 200 None
2026-01-28 20:15:40 [ayvens.be] INFO: Saving data for 1878685: {'created_time': 1769631340.737302, 'last_price_update_time': 1769631340.737312, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878685') HTTP/1.1" 204 0
2026-01-28 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/4.jpg not downloaded yet
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/5.jpg not downloaded yet
2026-01-28 20:15:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b24690>
2026-01-28 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/15.jpg saved to cache
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee8610>
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/4.jpg saved to cache
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/6.jpg not downloaded yet
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/7.jpg not downloaded yet
2026-01-28 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eea710>
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/3.jpg saved to cache
2026-01-28 20:15:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eea450>
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/6.jpg saved to cache
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/8.jpg not downloaded yet
2026-01-28 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/9.jpg not downloaded yet
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/10.jpg not downloaded yet
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98b90>
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/7.jpg saved to cache
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2c90>
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/8.jpg saved to cache
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df6210>
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/10.jpg saved to cache
2026-01-28 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d51150>
2026-01-28 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/9.jpg saved to cache
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99450>
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/11.jpg saved to cache
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/11.jpg not downloaded yet
2026-01-28 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d653d0>
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/12.jpg saved to cache
2026-01-28 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc9810>
2026-01-28 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/14.jpg saved to cache
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/12.jpg not downloaded yet
2026-01-28 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/13.jpg not downloaded yet
2026-01-28 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/14.jpg not downloaded yet
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa650>
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/15.jpg saved to cache
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2defdd0>
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ae%252F55521568f65e48ecae106c447c8879e6%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/13.jpg saved to cache
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bd4c9955-9b9c-54bb-8158-0509926d66e2
2026-01-28 20:15:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd4c9955-9b9c-54bb-8158-0509926d66e2, skipping ID generation
2026-01-28 20:15:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4c9955-9b9c-54bb-8158-0509926d66e2 with scrape type 1
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bd4c9955-9b9c-54bb-8158-0509926d66e2 from tracking dictionaries
2026-01-28 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd4c9955-9b9c-54bb-8158-0509926d66e2 sending to next pipeline
2026-01-28 20:15:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd4c9955-9b9c-54bb-8158-0509926d66e2, identifier: 1878686
2026-01-28 20:15:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd4c9955-9b9c-54bb-8158-0509926d66e2 with identifier: 1878686
2026-01-28 20:15:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:15:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd4c9955-9b9c-54bb-8158-0509926d66e2 with identifier: 1878686
2026-01-28 20:15:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd4c9955-9b9c-54bb-8158-0509926d66e2 with identifier: 1878686 to the API
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'NAVARRA BLUE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bd4c9955-9b9c-54bb-8158-0509926d66e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 60123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311467,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296062,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351671,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 379843,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd4c9955-9b9c-54bb-8158-0509926d66e2/bd4c9955-9b9c-54bb-8158-0509926d66e2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ae/55521568f65e48ecae106c447c8879e6/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 1.0 30 TFSI 81KW S TRONIC',
 'transmission': 'automatic',
 'trim': '1.0 30 TFSI 81KW S TRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878686%27 HTTP/1.1" 200 None
2026-01-28 20:15:45 [ayvens.be] INFO: Saving data for 1878686: {'created_time': 1769631345.272677, 'last_price_update_time': 1769631345.272686, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878686') HTTP/1.1" 204 0
2026-01-28 20:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:45 [ayvens.be] INFO: Found listing with ID: 1878688
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878688%27 HTTP/1.1" 200 None
2026-01-28 20:15:45 [ayvens.be] INFO: Scrape type for 1878688: 1
2026-01-28 20:15:45 [ayvens.be] INFO: Extracting data for car ID: 1878688
2026-01-28 20:15:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b4f0794-824d-5b17-92c8-fe603afae84b with identifier: 1878688
2026-01-28 20:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b4f0794-824d-5b17-92c8-fe603afae84b with scrape type 1
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/1.jpg not downloaded yet
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/2.jpg not downloaded yet
2026-01-28 20:15:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30c5550>
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ym%252F4417c9080c594cd8967a7fb7e830b73b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/7.jpg saved to cache
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2b13aa3-3708-539c-ba1c-e63f69066eeb
2026-01-28 20:15:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2b13aa3-3708-539c-ba1c-e63f69066eeb, skipping ID generation
2026-01-28 20:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b13aa3-3708-539c-ba1c-e63f69066eeb with scrape type 1
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2b13aa3-3708-539c-ba1c-e63f69066eeb from tracking dictionaries
2026-01-28 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2b13aa3-3708-539c-ba1c-e63f69066eeb sending to next pipeline
2026-01-28 20:15:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f2b13aa3-3708-539c-ba1c-e63f69066eeb, identifier: 1878683
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03950>
2026-01-28 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/12.jpg saved to cache
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d515d0>
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/2.jpg saved to cache
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cca4d0>
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yp%252F417f43ecaa2641a295658e487ae395d0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/6.jpg saved to cache
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80d0363d-93aa-5d28-b269-e027ba998cdd
2026-01-28 20:15:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80d0363d-93aa-5d28-b269-e027ba998cdd, skipping ID generation
2026-01-28 20:15:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d0363d-93aa-5d28-b269-e027ba998cdd with scrape type 1
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 80d0363d-93aa-5d28-b269-e027ba998cdd from tracking dictionaries
2026-01-28 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80d0363d-93aa-5d28-b269-e027ba998cdd sending to next pipeline
2026-01-28 20:15:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80d0363d-93aa-5d28-b269-e027ba998cdd, identifier: 1878677
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de7a90>
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/1.jpg saved to cache
2026-01-28 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/3.jpg not downloaded yet
2026-01-28 20:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f2b13aa3-3708-539c-ba1c-e63f69066eeb with identifier: 1878683
2026-01-28 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f2b13aa3-3708-539c-ba1c-e63f69066eeb with identifier: 1878683
2026-01-28 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186529 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    186529
2026-01-28 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f2b13aa3-3708-539c-ba1c-e63f69066eeb spider: ayvens.be
2026-01-28 20:15:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f2b13aa3-3708-539c-ba1c-e63f69066eeb due to rule: high_mileage_for_country.json, error: 186529 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    186529
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f2b13aa3-3708-539c-ba1c-e63f69066eeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA - Klasse',
 'odometer': 186529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660379,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 802712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 847000,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562917,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623189,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2b13aa3-3708-539c-ba1c-e63f69066eeb/f2b13aa3-3708-539c-ba1c-e63f69066eeb_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ym/4417c9080c594cd8967a7fb7e830b73b/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA - Klasse 1.5 CLA 180 D BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.5 CLA 180 D BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878683%27 HTTP/1.1" 200 None
2026-01-28 20:15:47 [ayvens.be] INFO: Saving data for 1878683: {'created_time': 1769631347.340262, 'last_price_update_time': 1769631347.340274, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878683') HTTP/1.1" 204 0
2026-01-28 20:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80d0363d-93aa-5d28-b269-e027ba998cdd with identifier: 1878677
2026-01-28 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80d0363d-93aa-5d28-b269-e027ba998cdd with identifier: 1878677
2026-01-28 20:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80d0363d-93aa-5d28-b269-e027ba998cdd with identifier: 1878677 to the API
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '80d0363d-93aa-5d28-b269-e027ba998cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008 DIESEL - 2020',
 'odometer': 122088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580669,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668805,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80d0363d-93aa-5d28-b269-e027ba998cdd/80d0363d-93aa-5d28-b269-e027ba998cdd_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yp/417f43ecaa2641a295658e487ae395d0/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 DIESEL - 2020 1.5 BlueHDi GT Line S&S',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi GT Line S&S',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878677%27 HTTP/1.1" 200 None
2026-01-28 20:15:47 [ayvens.be] INFO: Saving data for 1878677: {'created_time': 1769631347.795431, 'last_price_update_time': 1769631347.79544, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878677') HTTP/1.1" 204 0
2026-01-28 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/4.jpg not downloaded yet
2026-01-28 20:15:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f808d0>
2026-01-28 20:15:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/15.jpg saved to cache
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c79750>
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/5.jpg saved to cache
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/5.jpg not downloaded yet
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7110>
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/14.jpg saved to cache
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/6.jpg not downloaded yet
2026-01-28 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc4a50>
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/3.jpg saved to cache
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2ea90>
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/6.jpg saved to cache
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76a50>
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/4.jpg saved to cache
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1a90>
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/7.jpg saved to cache
2026-01-28 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/7.jpg not downloaded yet
2026-01-28 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/8.jpg not downloaded yet
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c00690>
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yd%252Fe1cd1dd082874ebbbacc62b715d8046c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/13.jpg saved to cache
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9
2026-01-28 20:15:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9, skipping ID generation
2026-01-28 20:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 with scrape type 1
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 from tracking dictionaries
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 sending to next pipeline
2026-01-28 20:15:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9, identifier: 1878671
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d67390>
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/8.jpg saved to cache
2026-01-28 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73890>
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/10.jpg saved to cache
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 with identifier: 1878671
2026-01-28 20:15:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 with identifier: 1878671
2026-01-28 20:15:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 129464 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129464
2026-01-28 20:15:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 spider: ayvens.be
2026-01-28 20:15:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 1a0c5363-c64b-5b7a-8b6e-acabea1698f9 due to rule: high_mileage_for_country.json, error: 129464 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129464
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a0c5363-c64b-5b7a-8b6e-acabea1698f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A7 SPORTBACK - 2018',
 'odometer': 129464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526808,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 481052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 860724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 775023,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633532,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609640,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a0c5363-c64b-5b7a-8b6e-acabea1698f9/1a0c5363-c64b-5b7a-8b6e-acabea1698f9_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714615,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yd/e1cd1dd082874ebbbacc62b715d8046c/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A7 SPORTBACK - 2018 55 TFSI e Quattro PHEV S tronic',
 'transmission': 'automatic',
 'trim': '55 TFSI e Quattro PHEV S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878671%27 HTTP/1.1" 200 None
2026-01-28 20:15:51 [ayvens.be] INFO: Saving data for 1878671: {'created_time': 1769631351.285307, 'last_price_update_time': 1769631351.285319, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878671') HTTP/1.1" 204 0
2026-01-28 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/9.jpg not downloaded yet
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/10.jpg not downloaded yet
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e985d0>
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/9.jpg saved to cache
2026-01-28 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db6550>
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/11.jpg saved to cache
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/11.jpg not downloaded yet
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/12.jpg not downloaded yet
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66d50>
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/12.jpg saved to cache
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/13.jpg not downloaded yet
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/14.jpg not downloaded yet
2026-01-28 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f282d0>
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/11.jpg saved to cache
2026-01-28 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e750>
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/14.jpg saved to cache
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/15.jpg not downloaded yet
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/16.jpg not downloaded yet
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/17.jpg not downloaded yet
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3e0d0>
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cr%252Ff4c05fd830ee401c96ff566cfe181675%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/13.jpg saved to cache
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 12138a8a-0342-5787-bd0f-503183394cd8
2026-01-28 20:15:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12138a8a-0342-5787-bd0f-503183394cd8, skipping ID generation
2026-01-28 20:15:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12138a8a-0342-5787-bd0f-503183394cd8 with scrape type 1
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12138a8a-0342-5787-bd0f-503183394cd8 from tracking dictionaries
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12138a8a-0342-5787-bd0f-503183394cd8 sending to next pipeline
2026-01-28 20:15:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 12138a8a-0342-5787-bd0f-503183394cd8, identifier: 1878687
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1790>
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/1.jpg saved to cache
2026-01-28 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7cbd0>
2026-01-28 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/2.jpg saved to cache
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70bd0>
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/10.jpg saved to cache
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60590>
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/9.jpg saved to cache
2026-01-28 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 12138a8a-0342-5787-bd0f-503183394cd8 with identifier: 1878687
2026-01-28 20:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 12138a8a-0342-5787-bd0f-503183394cd8 with identifier: 1878687
2026-01-28 20:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 12138a8a-0342-5787-bd0f-503183394cd8 with identifier: 1878687 to the API
2026-01-28 20:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:15:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '12138a8a-0342-5787-bd0f-503183394cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'C40',
 'odometer': 42419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 447721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460868,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345299,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431979,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328733,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12138a8a-0342-5787-bd0f-503183394cd8/12138a8a-0342-5787-bd0f-503183394cd8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395238,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cr/f4c05fd830ee401c96ff566cfe181675/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO C40 BEV 69KWH RECHARGE CORE',
 'transmission': 'automatic',
 'trim': 'BEV 69KWH RECHARGE CORE',
 'vin': None,
 'year': 2022}
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878687%27 HTTP/1.1" 200 None
2026-01-28 20:15:55 [ayvens.be] INFO: Saving data for 1878687: {'created_time': 1769631355.659445, 'last_price_update_time': 1769631355.659454, 'auction_closing_time': 1770107400.0}
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878687') HTTP/1.1" 204 0
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/18.jpg not downloaded yet
2026-01-28 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/19.jpg not downloaded yet
2026-01-28 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26f90>
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/3.jpg saved to cache
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:56 [ayvens.be] INFO: Found listing with ID: 1878689
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878689%27 HTTP/1.1" 200 None
2026-01-28 20:15:56 [ayvens.be] INFO: Scrape type for 1878689: 1
2026-01-28 20:15:56 [ayvens.be] INFO: Extracting data for car ID: 1878689
2026-01-28 20:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a39e077-0276-5eda-aa87-21b99d27736a with identifier: 1878689
2026-01-28 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a39e077-0276-5eda-aa87-21b99d27736a with scrape type 1
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/1.jpg not downloaded yet
2026-01-28 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/2.jpg not downloaded yet
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e5a0d0>
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/5.jpg saved to cache
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7dd10>
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/4.jpg saved to cache
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/3.jpg not downloaded yet
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/4.jpg not downloaded yet
2026-01-28 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e21410>
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/6.jpg saved to cache
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcfcd0>
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/8.jpg saved to cache
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd550>
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/7.jpg saved to cache
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/5.jpg not downloaded yet
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/6.jpg not downloaded yet
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/7.jpg not downloaded yet
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c67e10>
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/7.jpg saved to cache
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c01890>
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/6.jpg saved to cache
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/8.jpg not downloaded yet
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/9.jpg not downloaded yet
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/10.jpg not downloaded yet
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/11.jpg not downloaded yet
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/12.jpg not downloaded yet
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/13.jpg not downloaded yet
2026-01-28 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30ea8d0>
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/10.jpg saved to cache
2026-01-28 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcd450>
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/11.jpg saved to cache
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/14.jpg not downloaded yet
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c66c90>
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1xd%252Fcb59b2626927453196779f1472f8c3ce%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/5.jpg saved to cache
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8
2026-01-28 20:15:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8, skipping ID generation
2026-01-28 20:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with scrape type 1
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 from tracking dictionaries
2026-01-28 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 sending to next pipeline
2026-01-28 20:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8, identifier: 1878668
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82150>
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:15:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/14.jpg saved to cache
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dccf90>
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/12.jpg saved to cache
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82910>
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/9.jpg saved to cache
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/15.jpg not downloaded yet
2026-01-28 20:16:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with identifier: 1878668
2026-01-28 20:16:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with identifier: 1878668
2026-01-28 20:16:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a1c0cbb-f103-51e8-9fe3-31de5f59cff8 with identifier: 1878668 to the API
2026-01-28 20:16:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:16:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7a1c0cbb-f103-51e8-9fe3-31de5f59cff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASSE GLC DIESEL (X253) - 201',
 'odometer': 77328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659374,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689666,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 738923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668455,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595383,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1c0cbb-f103-51e8-9fe3-31de5f59cff8/7a1c0cbb-f103-51e8-9fe3-31de5f59cff8_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206807,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1xd/cb59b2626927453196779f1472f8c3ce/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASSE GLC DIESEL (X253) - 201 GLC 200 d Business '
          'Solution',
 'transmission': 'automatic',
 'trim': 'GLC 200 d Business Solution',
 'vin': None,
 'year': 2019}
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878668%27 HTTP/1.1" 200 None
2026-01-28 20:16:01 [ayvens.be] INFO: Saving data for 1878668: {'created_time': 1769631361.207715, 'last_price_update_time': 1769631361.207725, 'auction_closing_time': 1770107400.0}
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878668') HTTP/1.1" 204 0
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/16.jpg not downloaded yet
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2efd0>
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/8.jpg saved to cache
2026-01-28 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:01 [ayvens.be] INFO: Found listing with ID: 1878690
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878690%27 HTTP/1.1" 200 None
2026-01-28 20:16:01 [ayvens.be] INFO: Scrape type for 1878690: 1
2026-01-28 20:16:01 [ayvens.be] INFO: Extracting data for car ID: 1878690
2026-01-28 20:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39cb89de-8d59-5ce4-8497-fb6977f510a8 with identifier: 1878690
2026-01-28 20:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39cb89de-8d59-5ce4-8497-fb6977f510a8 with scrape type 1
2026-01-28 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/1.jpg not downloaded yet
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29850>
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/13.jpg saved to cache
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/2.jpg not downloaded yet
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/3.jpg not downloaded yet
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/4.jpg not downloaded yet
2026-01-28 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/5.jpg not downloaded yet
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/6.jpg not downloaded yet
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/7.jpg not downloaded yet
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/8.jpg not downloaded yet
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99e10>
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/14.jpg saved to cache
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c672d0>
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/17.jpg saved to cache
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/9.jpg not downloaded yet
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e07190>
2026-01-28 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/1.jpg saved to cache
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8d50>
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/18.jpg saved to cache
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8e10>
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/19.jpg saved to cache
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29550>
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/16.jpg saved to cache
2026-01-28 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f28090>
2026-01-28 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/2.jpg saved to cache
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/10.jpg not downloaded yet
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/11.jpg not downloaded yet
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d50bd0>
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/3.jpg saved to cache
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/12.jpg not downloaded yet
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/13.jpg not downloaded yet
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/14.jpg not downloaded yet
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/15.jpg not downloaded yet
2026-01-28 20:16:04 [ayvens.be] INFO: Found listing with ID: 1878691
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878691%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [ayvens.be] INFO: Scrape type for 1878691: 1
2026-01-28 20:16:04 [ayvens.be] INFO: Extracting data for car ID: 1878691
2026-01-28 20:16:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3147250c-5aa8-59df-af2c-b55adc3a2a1e with identifier: 1878691
2026-01-28 20:16:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e with scrape type 1
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/1.jpg not downloaded yet
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/2.jpg not downloaded yet
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05f10>
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/10.jpg saved to cache
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/3.jpg not downloaded yet
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb66d0>
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/13.jpg saved to cache
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ed1490>
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/9.jpg saved to cache
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/4.jpg not downloaded yet
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/5.jpg not downloaded yet
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3c290>
2026-01-28 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/5.jpg saved to cache
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36fd0>
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/8.jpg saved to cache
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d65b50>
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/6.jpg saved to cache
2026-01-28 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9710>
2026-01-28 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/7.jpg saved to cache
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64610>
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/14.jpg saved to cache
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/6.jpg not downloaded yet
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/7.jpg not downloaded yet
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/8.jpg not downloaded yet
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/9.jpg not downloaded yet
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/10.jpg not downloaded yet
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/11.jpg not downloaded yet
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/12.jpg not downloaded yet
2026-01-28 20:16:07 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 5 pages/min), scraped 56 items (at 6 items/min)
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/13.jpg not downloaded yet
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/14.jpg not downloaded yet
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9b50>
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/2.jpg saved to cache
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd1e50>
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/1.jpg saved to cache
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f83590>
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/11.jpg saved to cache
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/15.jpg not downloaded yet
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51d50>
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/16.jpg saved to cache
2026-01-28 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e510>
2026-01-28 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/15.jpg saved to cache
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8f4d0>
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/4.jpg saved to cache
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25c50>
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/3.jpg saved to cache
2026-01-28 20:16:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1ae50>
2026-01-28 20:16:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2eb%252F1d6d5a650d6b4ce798dcc6098aa06ff4%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/12.jpg saved to cache
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8a39e077-0276-5eda-aa87-21b99d27736a
2026-01-28 20:16:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a39e077-0276-5eda-aa87-21b99d27736a, skipping ID generation
2026-01-28 20:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a39e077-0276-5eda-aa87-21b99d27736a with scrape type 1
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8a39e077-0276-5eda-aa87-21b99d27736a from tracking dictionaries
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a39e077-0276-5eda-aa87-21b99d27736a sending to next pipeline
2026-01-28 20:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a39e077-0276-5eda-aa87-21b99d27736a, identifier: 1878689
2026-01-28 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a39e077-0276-5eda-aa87-21b99d27736a with identifier: 1878689
2026-01-28 20:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a39e077-0276-5eda-aa87-21b99d27736a with identifier: 1878689
2026-01-28 20:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8a39e077-0276-5eda-aa87-21b99d27736a with identifier: 1878689 to the API
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:16:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '8a39e077-0276-5eda-aa87-21b99d27736a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 23479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 515551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622458,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710545,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613653,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 470520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601039,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685423,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a39e077-0276-5eda-aa87-21b99d27736a/8a39e077-0276-5eda-aa87-21b99d27736a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2eb/1d6d5a650d6b4ce798dcc6098aa06ff4/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 128KW PRO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 128KW PRO',
 'vin': None,
 'year': 2023}
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878689%27 HTTP/1.1" 200 None
2026-01-28 20:16:10 [ayvens.be] INFO: Saving data for 1878689: {'created_time': 1769631370.874026, 'last_price_update_time': 1769631370.874039, 'auction_closing_time': 1770107400.0}
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878689') HTTP/1.1" 204 0
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/16.jpg not downloaded yet
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/17.jpg not downloaded yet
2026-01-28 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d956d0>
2026-01-28 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/10.jpg saved to cache
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/18.jpg not downloaded yet
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/19.jpg not downloaded yet
2026-01-28 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:11 [ayvens.be] INFO: Found listing with ID: 1878692
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878692%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [ayvens.be] INFO: Scrape type for 1878692: 1
2026-01-28 20:16:11 [ayvens.be] INFO: Extracting data for car ID: 1878692
2026-01-28 20:16:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5089f5-97e4-5462-a783-ca95d742caaa with identifier: 1878692
2026-01-28 20:16:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5089f5-97e4-5462-a783-ca95d742caaa with scrape type 1
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/1.jpg not downloaded yet
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb9d0>
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/3.jpg saved to cache
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/2.jpg not downloaded yet
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/3.jpg not downloaded yet
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65c90>
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/13.jpg saved to cache
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3cd0>
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/2.jpg saved to cache
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f63b90>
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/9.jpg saved to cache
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05750>
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/12.jpg saved to cache
2026-01-28 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e3090>
2026-01-28 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/11.jpg saved to cache
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05750>
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/8.jpg saved to cache
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/4.jpg not downloaded yet
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/5.jpg not downloaded yet
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/6.jpg not downloaded yet
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/7.jpg not downloaded yet
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/8.jpg not downloaded yet
2026-01-28 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/9.jpg not downloaded yet
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/10.jpg not downloaded yet
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/11.jpg not downloaded yet
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7bc90>
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/6.jpg saved to cache
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/12.jpg not downloaded yet
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/13.jpg not downloaded yet
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff0d50>
2026-01-28 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/14.jpg saved to cache
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ded390>
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/1.jpg saved to cache
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4b610>
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/5.jpg saved to cache
2026-01-28 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f992d0>
2026-01-28 20:16:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/4.jpg saved to cache
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def810>
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/15.jpg saved to cache
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff14d0>
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/7.jpg saved to cache
2026-01-28 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc6810>
2026-01-28 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/7.jpg saved to cache
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/14.jpg not downloaded yet
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/15.jpg not downloaded yet
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [ayvens.be] INFO: Found listing with ID: 1878693
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878693%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [ayvens.be] INFO: Scrape type for 1878693: 1
2026-01-28 20:16:16 [ayvens.be] INFO: Extracting data for car ID: 1878693
2026-01-28 20:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with identifier: 1878693
2026-01-28 20:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with scrape type 1
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/1.jpg not downloaded yet
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/2.jpg not downloaded yet
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/3.jpg not downloaded yet
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/4.jpg not downloaded yet
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/5.jpg not downloaded yet
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eba910>
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/14.jpg saved to cache
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/6.jpg not downloaded yet
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/7.jpg not downloaded yet
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4acd0>
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/16.jpg saved to cache
2026-01-28 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17ed0>
2026-01-28 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/13.jpg saved to cache
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0090>
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/18.jpg saved to cache
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e56710>
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/17.jpg saved to cache
2026-01-28 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49150>
2026-01-28 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/15.jpg saved to cache
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98f10>
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/12.jpg saved to cache
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd22d0>
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/19.jpg saved to cache
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/8.jpg not downloaded yet
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/9.jpg not downloaded yet
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/10.jpg not downloaded yet
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/11.jpg not downloaded yet
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/12.jpg not downloaded yet
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/13.jpg not downloaded yet
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/14.jpg not downloaded yet
2026-01-28 20:16:18 [ayvens.be] INFO: Found listing with ID: 1878694
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878694%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [ayvens.be] INFO: Scrape type for 1878694: 1
2026-01-28 20:16:18 [ayvens.be] INFO: Extracting data for car ID: 1878694
2026-01-28 20:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c250c49-b85e-5e8a-b306-26de910d24ab with identifier: 1878694
2026-01-28 20:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c250c49-b85e-5e8a-b306-26de910d24ab with scrape type 1
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/1.jpg not downloaded yet
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/2.jpg not downloaded yet
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee1dd0>
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/6.jpg saved to cache
2026-01-28 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5d3d0>
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/3.jpg saved to cache
2026-01-28 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78810>
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/1.jpg saved to cache
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52910>
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/11.jpg saved to cache
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee6f50>
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/2.jpg saved to cache
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df97d0>
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/5.jpg saved to cache
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/3.jpg not downloaded yet
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99610>
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/4.jpg saved to cache
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d675d0>
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/8.jpg saved to cache
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/4.jpg not downloaded yet
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/5.jpg not downloaded yet
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/6.jpg not downloaded yet
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/7.jpg not downloaded yet
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/8.jpg not downloaded yet
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/9.jpg not downloaded yet
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/10.jpg not downloaded yet
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/11.jpg not downloaded yet
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/12.jpg not downloaded yet
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e767d0>
2026-01-28 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/13.jpg saved to cache
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/13.jpg not downloaded yet
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76290>
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/11.jpg saved to cache
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccddd0>
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/15.jpg saved to cache
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/14.jpg not downloaded yet
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2f210>
2026-01-28 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/5.jpg saved to cache
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82e50>
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/4.jpg saved to cache
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbc890>
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/14.jpg saved to cache
2026-01-28 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd0150>
2026-01-28 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/6.jpg saved to cache
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/15.jpg not downloaded yet
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/16.jpg not downloaded yet
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/17.jpg not downloaded yet
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/18.jpg not downloaded yet
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/19.jpg not downloaded yet
2026-01-28 20:16:24 [ayvens.be] INFO: Found listing with ID: 1878695
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878695%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [ayvens.be] INFO: Scrape type for 1878695: 1
2026-01-28 20:16:24 [ayvens.be] INFO: Extracting data for car ID: 1878695
2026-01-28 20:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe196884-5a19-5aae-80cd-da43bbca4037 with identifier: 1878695
2026-01-28 20:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe196884-5a19-5aae-80cd-da43bbca4037 with scrape type 1
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/1.jpg not downloaded yet
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/2.jpg not downloaded yet
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de63d0>
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/2.jpg saved to cache
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee8ed0>
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/1.jpg saved to cache
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/3.jpg not downloaded yet
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6c710>
2026-01-28 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/12.jpg saved to cache
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef0f50>
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/3.jpg saved to cache
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef2850>
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/3.jpg saved to cache
2026-01-28 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2850>
2026-01-28 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/8.jpg saved to cache
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/4.jpg not downloaded yet
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/5.jpg not downloaded yet
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e92ed0>
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/7.jpg saved to cache
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2da50>
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/9.jpg saved to cache
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/6.jpg not downloaded yet
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/7.jpg not downloaded yet
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/8.jpg not downloaded yet
2026-01-28 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/9.jpg not downloaded yet
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/10.jpg not downloaded yet
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/11.jpg not downloaded yet
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/12.jpg not downloaded yet
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/13.jpg not downloaded yet
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d150>
2026-01-28 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/5.jpg saved to cache
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/14.jpg not downloaded yet
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/15.jpg not downloaded yet
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61790>
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/4.jpg saved to cache
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eadd10>
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/7.jpg saved to cache
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f162d0>
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/11.jpg saved to cache
2026-01-28 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51d10>
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/12.jpg saved to cache
2026-01-28 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e050>
2026-01-28 20:16:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/6.jpg saved to cache
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f99d50>
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/13.jpg saved to cache
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97b90>
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/14.jpg saved to cache
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/16.jpg not downloaded yet
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/17.jpg not downloaded yet
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/18.jpg not downloaded yet
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/19.jpg not downloaded yet
2026-01-28 20:16:29 [ayvens.be] INFO: Found listing with ID: 1878696
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878696%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [ayvens.be] INFO: Scrape type for 1878696: 1
2026-01-28 20:16:29 [ayvens.be] INFO: Extracting data for car ID: 1878696
2026-01-28 20:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with identifier: 1878696
2026-01-28 20:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with scrape type 1
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/1.jpg not downloaded yet
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/2.jpg not downloaded yet
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9450>
2026-01-28 20:16:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/16.jpg saved to cache
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/3.jpg not downloaded yet
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6e210>
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/14.jpg saved to cache
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1c050>
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/17.jpg saved to cache
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edae50>
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/2.jpg saved to cache
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/4.jpg not downloaded yet
2026-01-28 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/5.jpg not downloaded yet
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48a10>
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/12.jpg saved to cache
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f63810>
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/13.jpg saved to cache
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53810>
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/3.jpg saved to cache
2026-01-28 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15e50>
2026-01-28 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/15.jpg saved to cache
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/6.jpg not downloaded yet
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/7.jpg not downloaded yet
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/8.jpg not downloaded yet
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/9.jpg not downloaded yet
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/10.jpg not downloaded yet
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/11.jpg not downloaded yet
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e06f10>
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/1.jpg saved to cache
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/12.jpg not downloaded yet
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/13.jpg not downloaded yet
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccd490>
2026-01-28 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/18.jpg saved to cache
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44590>
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/5.jpg saved to cache
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7c290>
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/19.jpg saved to cache
2026-01-28 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b77390>
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/6.jpg saved to cache
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc0510>
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/7.jpg saved to cache
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e77950>
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/4.jpg saved to cache
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8fefbd0>
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/14.jpg saved to cache
2026-01-28 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/14.jpg not downloaded yet
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/15.jpg not downloaded yet
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/16.jpg not downloaded yet
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/17.jpg not downloaded yet
2026-01-28 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/18.jpg not downloaded yet
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/19.jpg not downloaded yet
2026-01-28 20:16:35 [ayvens.be] INFO: Found listing with ID: 1878697
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878697%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [ayvens.be] INFO: Scrape type for 1878697: 1
2026-01-28 20:16:35 [ayvens.be] INFO: Extracting data for car ID: 1878697
2026-01-28 20:16:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0065b5e-0e6e-54a5-b855-edb1854a5860 with identifier: 1878697
2026-01-28 20:16:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0065b5e-0e6e-54a5-b855-edb1854a5860 with scrape type 1
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/1.jpg not downloaded yet
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a890>
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/15.jpg saved to cache
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b990>
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/17.jpg saved to cache
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/2.jpg not downloaded yet
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37e90>
2026-01-28 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/13.jpg saved to cache
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6d310>
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/16.jpg saved to cache
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbd750>
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/12.jpg saved to cache
2026-01-28 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e613d0>
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/10.jpg saved to cache
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0fad0>
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/18.jpg saved to cache
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2857c10>
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/11.jpg saved to cache
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/3.jpg not downloaded yet
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/4.jpg not downloaded yet
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/5.jpg not downloaded yet
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/6.jpg not downloaded yet
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/7.jpg not downloaded yet
2026-01-28 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/8.jpg not downloaded yet
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/9.jpg not downloaded yet
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/10.jpg not downloaded yet
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb4710>
2026-01-28 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/4.jpg saved to cache
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2910>
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/5.jpg saved to cache
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9510>
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/2.jpg saved to cache
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/11.jpg not downloaded yet
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9450>
2026-01-28 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/1.jpg saved to cache
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7ccd0>
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/3.jpg saved to cache
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/12.jpg not downloaded yet
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/13.jpg not downloaded yet
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e93a10>
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/9.jpg saved to cache
2026-01-28 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2f510>
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/19.jpg saved to cache
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e9050>
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/6.jpg saved to cache
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/14.jpg not downloaded yet
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/15.jpg not downloaded yet
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [ayvens.be] INFO: Found listing with ID: 1878698
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878698%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [ayvens.be] INFO: Scrape type for 1878698: 1
2026-01-28 20:16:40 [ayvens.be] INFO: Extracting data for car ID: 1878698
2026-01-28 20:16:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00834b9c-c968-5f75-866c-70d62a7e97e1 with identifier: 1878698
2026-01-28 20:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00834b9c-c968-5f75-866c-70d62a7e97e1 with scrape type 1
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/1.jpg not downloaded yet
2026-01-28 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/2.jpg not downloaded yet
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/3.jpg not downloaded yet
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/4.jpg not downloaded yet
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff90d0>
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/2.jpg saved to cache
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/5.jpg not downloaded yet
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b43bd0>
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/13.jpg saved to cache
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/6.jpg not downloaded yet
2026-01-28 20:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/7.jpg not downloaded yet
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7fa90>
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/15.jpg saved to cache
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8a90>
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/16.jpg saved to cache
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48810>
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/14.jpg saved to cache
2026-01-28 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de6490>
2026-01-28 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/11.jpg saved to cache
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e535d0>
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/10.jpg saved to cache
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec73d0>
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/12.jpg saved to cache
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/8.jpg not downloaded yet
2026-01-28 20:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/9.jpg not downloaded yet
2026-01-28 20:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c250>
2026-01-28 20:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/4.jpg saved to cache
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee3810>
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/5.jpg saved to cache
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee1d50>
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/6.jpg saved to cache
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/10.jpg not downloaded yet
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/11.jpg not downloaded yet
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5e150>
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/1.jpg saved to cache
2026-01-28 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6ecd0>
2026-01-28 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/3.jpg saved to cache
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea1bd0>
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/18.jpg saved to cache
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f80750>
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/19.jpg saved to cache
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/12.jpg not downloaded yet
2026-01-28 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/13.jpg not downloaded yet
2026-01-28 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99f10>
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/17.jpg saved to cache
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/14.jpg not downloaded yet
2026-01-28 20:16:45 [ayvens.be] INFO: Found listing with ID: 1878699
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878699%27 HTTP/1.1" 200 None
2026-01-28 20:16:45 [ayvens.be] INFO: Scrape type for 1878699: 1
2026-01-28 20:16:45 [ayvens.be] INFO: Extracting data for car ID: 1878699
2026-01-28 20:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df60ad2c-f486-5daf-ac32-96b594f61118 with identifier: 1878699
2026-01-28 20:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df60ad2c-f486-5daf-ac32-96b594f61118 with scrape type 1
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/1.jpg not downloaded yet
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/2.jpg not downloaded yet
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef5f90>
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/12.jpg saved to cache
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b90050>
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/15.jpg saved to cache
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e272d0>
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/13.jpg saved to cache
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7ddd0>
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/14.jpg saved to cache
2026-01-28 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5ec50>
2026-01-28 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/9.jpg saved to cache
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/3.jpg not downloaded yet
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b116d0>
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/10.jpg saved to cache
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d67490>
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/8.jpg saved to cache
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/4.jpg not downloaded yet
2026-01-28 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/5.jpg not downloaded yet
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49250>
2026-01-28 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/5.jpg saved to cache
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/6.jpg not downloaded yet
2026-01-28 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/7.jpg not downloaded yet
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e05bd0>
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/11.jpg saved to cache
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/8.jpg not downloaded yet
2026-01-28 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/9.jpg not downloaded yet
2026-01-28 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/10.jpg not downloaded yet
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d49f50>
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/8.jpg saved to cache
2026-01-28 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b516d0>
2026-01-28 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/2.jpg saved to cache
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/11.jpg not downloaded yet
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/12.jpg not downloaded yet
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8ef50>
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/9.jpg saved to cache
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8c250>
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/6.jpg saved to cache
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/13.jpg not downloaded yet
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/14.jpg not downloaded yet
2026-01-28 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/15.jpg not downloaded yet
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31aaa90>
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/11.jpg saved to cache
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb76d0>
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/10.jpg saved to cache
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31b2a90>
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/1.jpg saved to cache
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/16.jpg not downloaded yet
2026-01-28 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/17.jpg not downloaded yet
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eebad0>
2026-01-28 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/7.jpg saved to cache
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85390>
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/3.jpg saved to cache
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb510>
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/4.jpg saved to cache
2026-01-28 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84bd0>
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2dl%252F7f817d51f7de47c39fe5d6138164df43%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/7.jpg saved to cache
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0065b5e-0e6e-54a5-b855-edb1854a5860
2026-01-28 20:16:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0065b5e-0e6e-54a5-b855-edb1854a5860, skipping ID generation
2026-01-28 20:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0065b5e-0e6e-54a5-b855-edb1854a5860 with scrape type 1
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f0065b5e-0e6e-54a5-b855-edb1854a5860 from tracking dictionaries
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0065b5e-0e6e-54a5-b855-edb1854a5860 sending to next pipeline
2026-01-28 20:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f0065b5e-0e6e-54a5-b855-edb1854a5860, identifier: 1878697
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/18.jpg not downloaded yet
2026-01-28 20:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f0065b5e-0e6e-54a5-b855-edb1854a5860 with identifier: 1878697
2026-01-28 20:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f0065b5e-0e6e-54a5-b855-edb1854a5860 with identifier: 1878697
2026-01-28 20:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f0065b5e-0e6e-54a5-b855-edb1854a5860 with identifier: 1878697 to the API
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f0065b5e-0e6e-54a5-b855-edb1854a5860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SCALA',
 'odometer': 69106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387171,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 403214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 298846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286634,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266304,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0065b5e-0e6e-54a5-b855-edb1854a5860/f0065b5e-0e6e-54a5-b855-edb1854a5860_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2dl/7f817d51f7de47c39fe5d6138164df43/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SCALA 1.5 TSI 110KW DSG7 CLEVER',
 'transmission': 'automatic',
 'trim': '1.5 TSI 110KW DSG7 CLEVER',
 'vin': None,
 'year': 2023}
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878697%27 HTTP/1.1" 200 None
2026-01-28 20:16:52 [ayvens.be] INFO: Saving data for 1878697: {'created_time': 1769631412.713853, 'last_price_update_time': 1769631412.713865, 'auction_closing_time': 1770107400.0}
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878697') HTTP/1.1" 204 0
2026-01-28 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/19.jpg not downloaded yet
2026-01-28 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:52 [ayvens.be] INFO: Found listing with ID: 1878700
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878700%27 HTTP/1.1" 200 None
2026-01-28 20:16:52 [ayvens.be] INFO: Scrape type for 1878700: 1
2026-01-28 20:16:52 [ayvens.be] INFO: Extracting data for car ID: 1878700
2026-01-28 20:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c with identifier: 1878700
2026-01-28 20:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c with scrape type 1
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/1.jpg not downloaded yet
2026-01-28 20:16:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a61790>
2026-01-28 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/12.jpg saved to cache
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e24a10>
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/13.jpg saved to cache
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/2.jpg not downloaded yet
2026-01-28 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/3.jpg not downloaded yet
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeb650>
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/2.jpg saved to cache
2026-01-28 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1c250>
2026-01-28 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/3.jpg saved to cache
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd3050>
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/4.jpg saved to cache
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b308d0>
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/5.jpg saved to cache
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/4.jpg not downloaded yet
2026-01-28 20:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/5.jpg not downloaded yet
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/6.jpg not downloaded yet
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd37d0>
2026-01-28 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/9.jpg saved to cache
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd0bd0>
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/7.jpg saved to cache
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd2690>
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/10.jpg saved to cache
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/7.jpg not downloaded yet
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/8.jpg not downloaded yet
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7dd50>
2026-01-28 20:16:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/9.jpg saved to cache
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/9.jpg not downloaded yet
2026-01-28 20:16:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/10.jpg not downloaded yet
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/11.jpg not downloaded yet
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74d90>
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Fd3e7991dbac94aeeb173f8e84f714d91%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/14.jpg saved to cache
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 00834b9c-c968-5f75-866c-70d62a7e97e1
2026-01-28 20:16:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00834b9c-c968-5f75-866c-70d62a7e97e1, skipping ID generation
2026-01-28 20:16:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00834b9c-c968-5f75-866c-70d62a7e97e1 with scrape type 1
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00834b9c-c968-5f75-866c-70d62a7e97e1 from tracking dictionaries
2026-01-28 20:16:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00834b9c-c968-5f75-866c-70d62a7e97e1 sending to next pipeline
2026-01-28 20:16:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00834b9c-c968-5f75-866c-70d62a7e97e1, identifier: 1878698
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e54310>
2026-01-28 20:16:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/8.jpg saved to cache
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86690>
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/6.jpg saved to cache
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b32450>
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/15.jpg saved to cache
2026-01-28 20:16:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ede450>
2026-01-28 20:16:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/11.jpg saved to cache
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ede450>
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/1.jpg saved to cache
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd1f90>
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/12.jpg saved to cache
2026-01-28 20:16:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00834b9c-c968-5f75-866c-70d62a7e97e1 with identifier: 1878698
2026-01-28 20:16:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00834b9c-c968-5f75-866c-70d62a7e97e1 with identifier: 1878698
2026-01-28 20:16:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00834b9c-c968-5f75-866c-70d62a7e97e1 with identifier: 1878698 to the API
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:16:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:16:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '00834b9c-c968-5f75-866c-70d62a7e97e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 33216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503915,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360845,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357969,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 484478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 444412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354335,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332347,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00834b9c-c968-5f75-866c-70d62a7e97e1/00834b9c-c968-5f75-866c-70d62a7e97e1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/d3e7991dbac94aeeb173f8e84f714d91/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 250 e PHEV Business Solution',
 'transmission': 'automatic',
 'trim': 'A 250 e PHEV Business Solution',
 'vin': None,
 'year': 2021}
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878698%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [ayvens.be] INFO: Saving data for 1878698: {'created_time': 1769631419.090998, 'last_price_update_time': 1769631419.091008, 'auction_closing_time': 1770107400.0}
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878698') HTTP/1.1" 204 0
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/12.jpg not downloaded yet
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/13.jpg not downloaded yet
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b650>
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/14.jpg saved to cache
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/14.jpg not downloaded yet
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/15.jpg not downloaded yet
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3410>
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/18.jpg saved to cache
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [ayvens.be] INFO: Found listing with ID: 1878701
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878701%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [ayvens.be] INFO: Scrape type for 1878701: 1
2026-01-28 20:16:59 [ayvens.be] INFO: Extracting data for car ID: 1878701
2026-01-28 20:16:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda896a4-618d-5f3b-89c2-1b19dcb713ae with identifier: 1878701
2026-01-28 20:16:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda896a4-618d-5f3b-89c2-1b19dcb713ae with scrape type 1
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/1.jpg not downloaded yet
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:16:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/2.jpg not downloaded yet
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8d27310>
2026-01-28 20:16:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:16:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/19.jpg saved to cache
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1d50>
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/16.jpg saved to cache
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/3.jpg not downloaded yet
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/4.jpg not downloaded yet
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/5.jpg not downloaded yet
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccc590>
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/17.jpg saved to cache
2026-01-28 20:17:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1a310>
2026-01-28 20:17:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cc%252Fcc271fc11718468caee184ee03fffd69%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/13.jpg saved to cache
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item df60ad2c-f486-5daf-ac32-96b594f61118
2026-01-28 20:17:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df60ad2c-f486-5daf-ac32-96b594f61118, skipping ID generation
2026-01-28 20:17:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df60ad2c-f486-5daf-ac32-96b594f61118 with scrape type 1
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df60ad2c-f486-5daf-ac32-96b594f61118 from tracking dictionaries
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df60ad2c-f486-5daf-ac32-96b594f61118 sending to next pipeline
2026-01-28 20:17:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df60ad2c-f486-5daf-ac32-96b594f61118, identifier: 1878699
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe55d0>
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/1.jpg saved to cache
2026-01-28 20:17:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1b4d0>
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/8.jpg saved to cache
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2ff10>
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/4.jpg saved to cache
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df60ad2c-f486-5daf-ac32-96b594f61118 with identifier: 1878699
2026-01-28 20:17:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df60ad2c-f486-5daf-ac32-96b594f61118 with identifier: 1878699
2026-01-28 20:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 122277 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    122277
2026-01-28 20:17:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: df60ad2c-f486-5daf-ac32-96b594f61118 spider: ayvens.be
2026-01-28 20:17:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: df60ad2c-f486-5daf-ac32-96b594f61118 due to rule: high_mileage_for_make.json, error: 122277 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    122277
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'PEARL WHITE MULTI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'df60ad2c-f486-5daf-ac32-96b594f61118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 122277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479658,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483943,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 467121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 765131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 428563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497797,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443844,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df60ad2c-f486-5daf-ac32-96b594f61118/df60ad2c-f486-5daf-ac32-96b594f61118_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cc/cc271fc11718468caee184ee03fffd69/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878699%27 HTTP/1.1" 200 None
2026-01-28 20:17:02 [ayvens.be] INFO: Saving data for 1878699: {'created_time': 1769631422.62126, 'last_price_update_time': 1769631422.621271, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878699') HTTP/1.1" 204 0
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/6.jpg not downloaded yet
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/7.jpg not downloaded yet
2026-01-28 20:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d49710>
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/6.jpg saved to cache
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/8.jpg not downloaded yet
2026-01-28 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/9.jpg not downloaded yet
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e92610>
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/7.jpg saved to cache
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f369d0>
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/5.jpg saved to cache
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/10.jpg not downloaded yet
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/11.jpg not downloaded yet
2026-01-28 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e83d0>
2026-01-28 20:17:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/2.jpg saved to cache
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8cb10>
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252Fdd80d11552ac459d83e0caf4be30f0c0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/7.jpg saved to cache
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8
2026-01-28 20:17:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8, skipping ID generation
2026-01-28 20:17:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with scrape type 1
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 from tracking dictionaries
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 sending to next pipeline
2026-01-28 20:17:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8, identifier: 1878696
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfba50>
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/3.jpg saved to cache
2026-01-28 20:17:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e0ad0>
2026-01-28 20:17:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/9.jpg saved to cache
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/12.jpg not downloaded yet
2026-01-28 20:17:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with identifier: 1878696
2026-01-28 20:17:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with identifier: 1878696
2026-01-28 20:17:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fcea33bc-c6c2-554f-83c7-0b6ac656cfe8 with identifier: 1878696 to the API
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fcea33bc-c6c2-554f-83c7-0b6ac656cfe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN TOURER',
 'odometer': 76690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521034,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536180,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 735087,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 733848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 964139,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608088,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658205,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682520,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcea33bc-c6c2-554f-83c7-0b6ac656cfe8/fcea33bc-c6c2-554f-83c7-0b6ac656cfe8_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557319,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/dd80d11552ac459d83e0caf4be30f0c0/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN TOURER 2.0 218D (110KW) GRAN TOURER',
 'transmission': 'manual',
 'trim': '2.0 218D (110KW) GRAN TOURER',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878696%27 HTTP/1.1" 200 None
2026-01-28 20:17:05 [ayvens.be] INFO: Saving data for 1878696: {'created_time': 1769631425.499995, 'last_price_update_time': 1769631425.500008, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878696') HTTP/1.1" 204 0
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/13.jpg not downloaded yet
2026-01-28 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/14.jpg not downloaded yet
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e54290>
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F7c4ae98a0dbf4d06a064626f443b3fe4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/8.jpg saved to cache
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe196884-5a19-5aae-80cd-da43bbca4037
2026-01-28 20:17:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe196884-5a19-5aae-80cd-da43bbca4037, skipping ID generation
2026-01-28 20:17:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe196884-5a19-5aae-80cd-da43bbca4037 with scrape type 1
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fe196884-5a19-5aae-80cd-da43bbca4037 from tracking dictionaries
2026-01-28 20:17:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe196884-5a19-5aae-80cd-da43bbca4037 sending to next pipeline
2026-01-28 20:17:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe196884-5a19-5aae-80cd-da43bbca4037, identifier: 1878695
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5e650>
2026-01-28 20:17:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/12.jpg saved to cache
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe196884-5a19-5aae-80cd-da43bbca4037 with identifier: 1878695
2026-01-28 20:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe196884-5a19-5aae-80cd-da43bbca4037 with identifier: 1878695
2026-01-28 20:17:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fe196884-5a19-5aae-80cd-da43bbca4037 with identifier: 1878695 to the API
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fe196884-5a19-5aae-80cd-da43bbca4037',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLC DIESEL (X253) - 2019',
 'odometer': 80662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541517,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516096,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599300,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 732990,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698721,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727931,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624939,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584836,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596916,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe196884-5a19-5aae-80cd-da43bbca4037/fe196884-5a19-5aae-80cd-da43bbca4037_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654815,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/7c4ae98a0dbf4d06a064626f443b3fe4/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLC DIESEL (X253) - 2019 GLC 200 d Business '
          'Solution',
 'transmission': 'automatic',
 'trim': 'GLC 200 d Business Solution',
 'vin': None,
 'year': 2022}
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878695%27 HTTP/1.1" 200 None
2026-01-28 20:17:06 [ayvens.be] INFO: Saving data for 1878695: {'created_time': 1769631426.535704, 'last_price_update_time': 1769631426.535714, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878695') HTTP/1.1" 204 0
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/15.jpg not downloaded yet
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/16.jpg not downloaded yet
2026-01-28 20:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e5d0>
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/10.jpg saved to cache
2026-01-28 20:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5df10>
2026-01-28 20:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/15.jpg saved to cache
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d58f50>
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/14.jpg saved to cache
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8290>
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/13.jpg saved to cache
2026-01-28 20:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb9ed0>
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/11.jpg saved to cache
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:08 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at -7 pages/min), scraped 61 items (at 5 items/min)
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/17.jpg not downloaded yet
2026-01-28 20:17:08 [ayvens.be] INFO: Found listing with ID: 1878702
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878702%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [ayvens.be] INFO: Scrape type for 1878702: 1
2026-01-28 20:17:08 [ayvens.be] INFO: Extracting data for car ID: 1878702
2026-01-28 20:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64187ebb-e314-5a14-bf4e-0ce473142941 with identifier: 1878702
2026-01-28 20:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64187ebb-e314-5a14-bf4e-0ce473142941 with scrape type 1
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/1.jpg not downloaded yet
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db7b50>
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/1.jpg saved to cache
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/2.jpg not downloaded yet
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/3.jpg not downloaded yet
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/4.jpg not downloaded yet
2026-01-28 20:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/5.jpg not downloaded yet
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/6.jpg not downloaded yet
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/7.jpg not downloaded yet
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9190>
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F8d3d83de75114714a9223c8b4a68ae4e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/8.jpg saved to cache
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c
2026-01-28 20:17:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c, skipping ID generation
2026-01-28 20:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c with scrape type 1
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c from tracking dictionaries
2026-01-28 20:17:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06f15a87-1821-5881-ab88-0a0c0bbe4d9c sending to next pipeline
2026-01-28 20:17:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c, identifier: 1878700
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebab90>
2026-01-28 20:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/5.jpg saved to cache
2026-01-28 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/8.jpg not downloaded yet
2026-01-28 20:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c with identifier: 1878700
2026-01-28 20:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c with identifier: 1878700
2026-01-28 20:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130200 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    130200
2026-01-28 20:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c spider: ayvens.be
2026-01-28 20:17:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 06f15a87-1821-5881-ab88-0a0c0bbe4d9c due to rule: high_mileage_for_country.json, error: 130200 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    130200
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '06f15a87-1821-5881-ab88-0a0c0bbe4d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 130200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596894,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726104,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560168,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594752,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726191,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 494760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472825,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06f15a87-1821-5881-ab88-0a0c0bbe4d9c/06f15a87-1821-5881-ab88-0a0c0bbe4d9c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/8d3d83de75114714a9223c8b4a68ae4e/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 D3 GEARTRONIC MOMENTUM PRO',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC MOMENTUM PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878700%27 HTTP/1.1" 200 None
2026-01-28 20:17:09 [ayvens.be] INFO: Saving data for 1878700: {'created_time': 1769631429.612663, 'last_price_update_time': 1769631429.612672, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878700') HTTP/1.1" 204 0
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa390>
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/7.jpg saved to cache
2026-01-28 20:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff87d0>
2026-01-28 20:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/3.jpg saved to cache
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e27c10>
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/4.jpg saved to cache
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/9.jpg not downloaded yet
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/10.jpg not downloaded yet
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2250>
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/6.jpg saved to cache
2026-01-28 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e650>
2026-01-28 20:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/2.jpg saved to cache
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/11.jpg not downloaded yet
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/12.jpg not downloaded yet
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c2c990>
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/8.jpg saved to cache
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/13.jpg not downloaded yet
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/14.jpg not downloaded yet
2026-01-28 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:11 [ayvens.be] INFO: Found listing with ID: 1878703
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878703%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [ayvens.be] INFO: Scrape type for 1878703: 1
2026-01-28 20:17:11 [ayvens.be] INFO: Extracting data for car ID: 1878703
2026-01-28 20:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with identifier: 1878703
2026-01-28 20:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with scrape type 1
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/1.jpg not downloaded yet
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f510>
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/12.jpg saved to cache
2026-01-28 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d550>
2026-01-28 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/9.jpg saved to cache
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db67d0>
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/11.jpg saved to cache
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a450>
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/10.jpg saved to cache
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/2.jpg not downloaded yet
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/3.jpg not downloaded yet
2026-01-28 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14750>
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/11.jpg saved to cache
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d290>
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/13.jpg saved to cache
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e45c50>
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/14.jpg saved to cache
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3081bd0>
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/1.jpg saved to cache
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/4.jpg not downloaded yet
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/5.jpg not downloaded yet
2026-01-28 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/6.jpg not downloaded yet
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e59e50>
2026-01-28 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/15.jpg saved to cache
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce8190>
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/17.jpg saved to cache
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcea90>
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/3.jpg saved to cache
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8090>
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/2.jpg saved to cache
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/7.jpg not downloaded yet
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/8.jpg not downloaded yet
2026-01-28 20:17:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43950>
2026-01-28 20:17:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/4.jpg saved to cache
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4a610>
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bg%252F52a701efa8e544deb0ccb11579721955%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/16.jpg saved to cache
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fda896a4-618d-5f3b-89c2-1b19dcb713ae
2026-01-28 20:17:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fda896a4-618d-5f3b-89c2-1b19dcb713ae, skipping ID generation
2026-01-28 20:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda896a4-618d-5f3b-89c2-1b19dcb713ae with scrape type 1
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fda896a4-618d-5f3b-89c2-1b19dcb713ae from tracking dictionaries
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fda896a4-618d-5f3b-89c2-1b19dcb713ae sending to next pipeline
2026-01-28 20:17:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fda896a4-618d-5f3b-89c2-1b19dcb713ae, identifier: 1878701
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffb8d0>
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/10.jpg saved to cache
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/9.jpg not downloaded yet
2026-01-28 20:17:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fda896a4-618d-5f3b-89c2-1b19dcb713ae with identifier: 1878701
2026-01-28 20:17:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fda896a4-618d-5f3b-89c2-1b19dcb713ae with identifier: 1878701
2026-01-28 20:17:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fda896a4-618d-5f3b-89c2-1b19dcb713ae with identifier: 1878701 to the API
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fda896a4-618d-5f3b-89c2-1b19dcb713ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 59551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576784,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594496,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592411,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585051,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378905,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634032,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524278,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fda896a4-618d-5f3b-89c2-1b19dcb713ae/fda896a4-618d-5f3b-89c2-1b19dcb713ae_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bg/52a701efa8e544deb0ccb11579721955/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160',
 'transmission': 'manual',
 'trim': 'A 160',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878701%27 HTTP/1.1" 200 None
2026-01-28 20:17:16 [ayvens.be] INFO: Saving data for 1878701: {'created_time': 1769631436.273872, 'last_price_update_time': 1769631436.273923, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878701') HTTP/1.1" 204 0
2026-01-28 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/10.jpg not downloaded yet
2026-01-28 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/11.jpg not downloaded yet
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e916d0>
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/10.jpg saved to cache
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1f350>
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/8.jpg saved to cache
2026-01-28 20:17:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edf310>
2026-01-28 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/7.jpg saved to cache
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/12.jpg not downloaded yet
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/13.jpg not downloaded yet
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2810>
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/11.jpg saved to cache
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dd2e50>
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/9.jpg saved to cache
2026-01-28 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2ef10>
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/12.jpg saved to cache
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31abc10>
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/6.jpg saved to cache
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee2c90>
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/5.jpg saved to cache
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/14.jpg not downloaded yet
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/15.jpg not downloaded yet
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/16.jpg not downloaded yet
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce8d90>
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/14.jpg saved to cache
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/17.jpg not downloaded yet
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/18.jpg not downloaded yet
2026-01-28 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4ae50>
2026-01-28 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/1.jpg saved to cache
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5f310>
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/2.jpg saved to cache
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8e04250>
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cv%252F989fd43f2bad447bba24392bf932002d%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/13.jpg saved to cache
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 64187ebb-e314-5a14-bf4e-0ce473142941
2026-01-28 20:17:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64187ebb-e314-5a14-bf4e-0ce473142941, skipping ID generation
2026-01-28 20:17:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64187ebb-e314-5a14-bf4e-0ce473142941 with scrape type 1
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 64187ebb-e314-5a14-bf4e-0ce473142941 from tracking dictionaries
2026-01-28 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64187ebb-e314-5a14-bf4e-0ce473142941 sending to next pipeline
2026-01-28 20:17:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 64187ebb-e314-5a14-bf4e-0ce473142941, identifier: 1878702
2026-01-28 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/19.jpg not downloaded yet
2026-01-28 20:17:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 64187ebb-e314-5a14-bf4e-0ce473142941 with identifier: 1878702
2026-01-28 20:17:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 64187ebb-e314-5a14-bf4e-0ce473142941 with identifier: 1878702
2026-01-28 20:17:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 64187ebb-e314-5a14-bf4e-0ce473142941 with identifier: 1878702 to the API
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '64187ebb-e314-5a14-bf4e-0ce473142941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 35653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260854,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247050,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292759,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278456,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331901,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64187ebb-e314-5a14-bf4e-0ce473142941/64187ebb-e314-5a14-bf4e-0ce473142941_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cv/989fd43f2bad447bba24392bf932002d/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878702%27 HTTP/1.1" 200 None
2026-01-28 20:17:20 [ayvens.be] INFO: Saving data for 1878702: {'created_time': 1769631440.502182, 'last_price_update_time': 1769631440.502196, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878702') HTTP/1.1" 204 0
2026-01-28 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/20.jpg not downloaded yet
2026-01-28 20:17:20 [ayvens.be] INFO: Found listing with ID: 1878704
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878704%27 HTTP/1.1" 200 None
2026-01-28 20:17:20 [ayvens.be] INFO: Scrape type for 1878704: 1
2026-01-28 20:17:20 [ayvens.be] INFO: Extracting data for car ID: 1878704
2026-01-28 20:17:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with identifier: 1878704
2026-01-28 20:17:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with scrape type 1
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/1.jpg not downloaded yet
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4a490>
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/3.jpg saved to cache
2026-01-28 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72290>
2026-01-28 20:17:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/9.jpg saved to cache
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43cd0>
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/5.jpg saved to cache
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e16610>
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/4.jpg saved to cache
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/2.jpg not downloaded yet
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/3.jpg not downloaded yet
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64550>
2026-01-28 20:17:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/6.jpg saved to cache
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/4.jpg not downloaded yet
2026-01-28 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/5.jpg not downloaded yet
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/6.jpg not downloaded yet
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f282d0>
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/7.jpg saved to cache
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef5350>
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F9ea70c312a5d46dd8786c164ed7bf2ed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/8.jpg saved to cache
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c250c49-b85e-5e8a-b306-26de910d24ab
2026-01-28 20:17:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c250c49-b85e-5e8a-b306-26de910d24ab, skipping ID generation
2026-01-28 20:17:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c250c49-b85e-5e8a-b306-26de910d24ab with scrape type 1
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3c250c49-b85e-5e8a-b306-26de910d24ab from tracking dictionaries
2026-01-28 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c250c49-b85e-5e8a-b306-26de910d24ab sending to next pipeline
2026-01-28 20:17:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c250c49-b85e-5e8a-b306-26de910d24ab, identifier: 1878694
2026-01-28 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c250c49-b85e-5e8a-b306-26de910d24ab with identifier: 1878694
2026-01-28 20:17:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c250c49-b85e-5e8a-b306-26de910d24ab with identifier: 1878694
2026-01-28 20:17:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3c250c49-b85e-5e8a-b306-26de910d24ab with identifier: 1878694 to the API
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3c250c49-b85e-5e8a-b306-26de910d24ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 48395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527320,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 483579,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707195,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 701025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633973,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581770,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538595,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c250c49-b85e-5e8a-b306-26de910d24ab/3c250c49-b85e-5e8a-b306-26de910d24ab_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514045,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/9ea70c312a5d46dd8786c164ed7bf2ed/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878694%27 HTTP/1.1" 200 None
2026-01-28 20:17:23 [ayvens.be] INFO: Saving data for 1878694: {'created_time': 1769631443.263713, 'last_price_update_time': 1769631443.263724, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878694') HTTP/1.1" 204 0
2026-01-28 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/7.jpg not downloaded yet
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef5990>
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/10.jpg saved to cache
2026-01-28 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5cd10>
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/10.jpg saved to cache
2026-01-28 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee25d0>
2026-01-28 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/8.jpg saved to cache
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c510>
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/9.jpg saved to cache
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/8.jpg not downloaded yet
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaa390>
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/11.jpg saved to cache
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3090>
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/2.jpg saved to cache
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/9.jpg not downloaded yet
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/10.jpg not downloaded yet
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/11.jpg not downloaded yet
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/12.jpg not downloaded yet
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/13.jpg not downloaded yet
2026-01-28 20:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/14.jpg not downloaded yet
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b6a450>
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/14.jpg saved to cache
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e210>
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/13.jpg saved to cache
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/15.jpg not downloaded yet
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/16.jpg not downloaded yet
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/17.jpg not downloaded yet
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df5550>
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/16.jpg saved to cache
2026-01-28 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea7490>
2026-01-28 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/12.jpg saved to cache
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35250>
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/17.jpg saved to cache
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f17850>
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/15.jpg saved to cache
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e34050>
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/19.jpg saved to cache
2026-01-28 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f050>
2026-01-28 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/18.jpg saved to cache
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/18.jpg not downloaded yet
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/19.jpg not downloaded yet
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/20.jpg not downloaded yet
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [ayvens.be] INFO: Found listing with ID: 1878705
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878705%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [ayvens.be] INFO: Scrape type for 1878705: 1
2026-01-28 20:17:27 [ayvens.be] INFO: Extracting data for car ID: 1878705
2026-01-28 20:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with identifier: 1878705
2026-01-28 20:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with scrape type 1
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/1.jpg not downloaded yet
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/2.jpg not downloaded yet
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97c50>
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/1.jpg saved to cache
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/3.jpg not downloaded yet
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2f990>
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bh%252F8f33317ad7324899bcebc14bd45a6751%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/20.jpg saved to cache
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658
2026-01-28 20:17:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658, skipping ID generation
2026-01-28 20:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with scrape type 1
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 from tracking dictionaries
2026-01-28 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 sending to next pipeline
2026-01-28 20:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658, identifier: 1878703
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/4.jpg not downloaded yet
2026-01-28 20:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with identifier: 1878703
2026-01-28 20:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with identifier: 1878703
2026-01-28 20:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b10f5cfe-6d57-5d6b-993a-3ed24b9d3658 with identifier: 1878703 to the API
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b10f5cfe-6d57-5d6b-993a-3ed24b9d3658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 62037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638656,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656460,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632385,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697132,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594258,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596159,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676722,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630178,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590294,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 596478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10f5cfe-6d57-5d6b-993a-3ed24b9d3658/b10f5cfe-6d57-5d6b-993a-3ed24b9d3658_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bh/8f33317ad7324899bcebc14bd45a6751/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878703%27 HTTP/1.1" 200 None
2026-01-28 20:17:28 [ayvens.be] INFO: Saving data for 1878703: {'created_time': 1769631448.431547, 'last_price_update_time': 1769631448.431559, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878703') HTTP/1.1" 204 0
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea20d0>
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yw%252F4042829c961f45708c2f9c7cdfab82ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/1.jpg saved to cache
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3
2026-01-28 20:17:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3666af9b-8576-5b59-9dfa-dc463bf54fb3, skipping ID generation
2026-01-28 20:17:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with scrape type 1
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3666af9b-8576-5b59-9dfa-dc463bf54fb3 from tracking dictionaries
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3666af9b-8576-5b59-9dfa-dc463bf54fb3 sending to next pipeline
2026-01-28 20:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3666af9b-8576-5b59-9dfa-dc463bf54fb3, identifier: 1878693
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d854d0>
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/2.jpg saved to cache
2026-01-28 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e36590>
2026-01-28 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/3.jpg saved to cache
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d84bd0>
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/4.jpg saved to cache
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50c50>
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/5.jpg saved to cache
2026-01-28 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6f6d0>
2026-01-28 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/6.jpg saved to cache
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/5.jpg not downloaded yet
2026-01-28 20:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with identifier: 1878693
2026-01-28 20:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with identifier: 1878693
2026-01-28 20:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3666af9b-8576-5b59-9dfa-dc463bf54fb3 with identifier: 1878693 to the API
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3666af9b-8576-5b59-9dfa-dc463bf54fb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA',
 'odometer': 94944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653541,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631591,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674368,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698781,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606169,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631130,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3666af9b-8576-5b59-9dfa-dc463bf54fb3/3666af9b-8576-5b59-9dfa-dc463bf54fb3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yw/4042829c961f45708c2f9c7cdfab82ca/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA 1.8 HYBRID DYNAMIC E-CVT',
 'transmission': 'automatic',
 'trim': '1.8 HYBRID DYNAMIC E-CVT',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878693%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [ayvens.be] INFO: Saving data for 1878693: {'created_time': 1769631450.429915, 'last_price_update_time': 1769631450.429924, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878693') HTTP/1.1" 204 0
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/6.jpg not downloaded yet
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/7.jpg not downloaded yet
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/8.jpg not downloaded yet
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/9.jpg not downloaded yet
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/10.jpg not downloaded yet
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/11.jpg not downloaded yet
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/12.jpg not downloaded yet
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/13.jpg not downloaded yet
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/14.jpg not downloaded yet
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e950>
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/9.jpg saved to cache
2026-01-28 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e450>
2026-01-28 20:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/10.jpg saved to cache
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b610>
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/10.jpg saved to cache
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/15.jpg not downloaded yet
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4bb10>
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/8.jpg saved to cache
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72a50>
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/7.jpg saved to cache
2026-01-28 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99e90>
2026-01-28 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/11.jpg saved to cache
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e06a50>
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/14.jpg saved to cache
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9ae50>
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/15.jpg saved to cache
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/16.jpg not downloaded yet
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/17.jpg not downloaded yet
2026-01-28 20:17:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/18.jpg not downloaded yet
2026-01-28 20:17:32 [ayvens.be] INFO: Found listing with ID: 1878706
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878706%27 HTTP/1.1" 200 None
2026-01-28 20:17:32 [ayvens.be] INFO: Scrape type for 1878706: 1
2026-01-28 20:17:32 [ayvens.be] INFO: Extracting data for car ID: 1878706
2026-01-28 20:17:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with identifier: 1878706
2026-01-28 20:17:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with scrape type 1
2026-01-28 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/1.jpg not downloaded yet
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/2.jpg not downloaded yet
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/3.jpg not downloaded yet
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/4.jpg not downloaded yet
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/5.jpg not downloaded yet
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ecd0>
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/18.jpg saved to cache
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/6.jpg not downloaded yet
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/7.jpg not downloaded yet
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/8.jpg not downloaded yet
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef19d0>
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/2.jpg saved to cache
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26a10>
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/3.jpg saved to cache
2026-01-28 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44050>
2026-01-28 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/19.jpg saved to cache
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e463d0>
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/13.jpg saved to cache
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbe290>
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/17.jpg saved to cache
2026-01-28 20:17:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b6af90>
2026-01-28 20:17:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/12.jpg saved to cache
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3080d90>
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/16.jpg saved to cache
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/9.jpg not downloaded yet
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/10.jpg not downloaded yet
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/11.jpg not downloaded yet
2026-01-28 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/12.jpg not downloaded yet
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/13.jpg not downloaded yet
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/14.jpg not downloaded yet
2026-01-28 20:17:35 [ayvens.be] INFO: Found listing with ID: 1878707
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878707%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [ayvens.be] INFO: Scrape type for 1878707: 1
2026-01-28 20:17:35 [ayvens.be] INFO: Extracting data for car ID: 1878707
2026-01-28 20:17:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with identifier: 1878707
2026-01-28 20:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with scrape type 1
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/1.jpg not downloaded yet
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8cc90>
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/7.jpg saved to cache
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c66190>
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/15.jpg saved to cache
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/2.jpg not downloaded yet
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e56510>
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/5.jpg saved to cache
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3f50>
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/12.jpg saved to cache
2026-01-28 20:17:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea4e90>
2026-01-28 20:17:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/14.jpg saved to cache
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5fdd0>
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/11.jpg saved to cache
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c09450>
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/13.jpg saved to cache
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3910>
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/6.jpg saved to cache
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/3.jpg not downloaded yet
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/4.jpg not downloaded yet
2026-01-28 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/5.jpg not downloaded yet
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/6.jpg not downloaded yet
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/7.jpg not downloaded yet
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/8.jpg not downloaded yet
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/9.jpg not downloaded yet
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/10.jpg not downloaded yet
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/11.jpg not downloaded yet
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d70410>
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/16.jpg saved to cache
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea9d10>
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/17.jpg saved to cache
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/12.jpg not downloaded yet
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8fb90>
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/10.jpg saved to cache
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2b50>
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/1.jpg saved to cache
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66e90>
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/18.jpg saved to cache
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e77ad0>
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/6.jpg saved to cache
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/13.jpg not downloaded yet
2026-01-28 20:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/14.jpg not downloaded yet
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78890>
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/9.jpg saved to cache
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a617d0>
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/8.jpg saved to cache
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/15.jpg not downloaded yet
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/16.jpg not downloaded yet
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb8ed0>
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/10.jpg saved to cache
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc3d10>
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/9.jpg saved to cache
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/17.jpg not downloaded yet
2026-01-28 20:17:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:40 [ayvens.be] INFO: Found listing with ID: 1878708
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878708%27 HTTP/1.1" 200 None
2026-01-28 20:17:40 [ayvens.be] INFO: Scrape type for 1878708: 1
2026-01-28 20:17:40 [ayvens.be] INFO: Extracting data for car ID: 1878708
2026-01-28 20:17:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679989ed-9c17-5dbc-a99d-87aeb985a708 with identifier: 1878708
2026-01-28 20:17:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679989ed-9c17-5dbc-a99d-87aeb985a708 with scrape type 1
2026-01-28 20:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/1.jpg not downloaded yet
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/2.jpg not downloaded yet
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5eb10>
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/7.jpg saved to cache
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe6f90>
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/8.jpg saved to cache
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3081790>
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/5.jpg saved to cache
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/3.jpg not downloaded yet
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/4.jpg not downloaded yet
2026-01-28 20:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e240d0>
2026-01-28 20:17:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/2.jpg saved to cache
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6ec90>
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/3.jpg saved to cache
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25310>
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/4.jpg saved to cache
2026-01-28 20:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/5.jpg not downloaded yet
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/6.jpg not downloaded yet
2026-01-28 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/7.jpg not downloaded yet
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98090>
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/5.jpg saved to cache
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/8.jpg not downloaded yet
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/9.jpg not downloaded yet
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e15550>
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/3.jpg saved to cache
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e997d0>
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/4.jpg saved to cache
2026-01-28 20:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cccb50>
2026-01-28 20:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/13.jpg saved to cache
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99e50>
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/6.jpg saved to cache
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeb650>
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/14.jpg saved to cache
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99610>
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/12.jpg saved to cache
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/10.jpg not downloaded yet
2026-01-28 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/11.jpg not downloaded yet
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/12.jpg not downloaded yet
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66350>
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/1.jpg saved to cache
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/13.jpg not downloaded yet
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/14.jpg not downloaded yet
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d87d90>
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/11.jpg saved to cache
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/15.jpg not downloaded yet
2026-01-28 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/16.jpg not downloaded yet
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/17.jpg not downloaded yet
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e24c50>
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/13.jpg saved to cache
2026-01-28 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2e2d0>
2026-01-28 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/14.jpg saved to cache
2026-01-28 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31ed0>
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/9.jpg saved to cache
2026-01-28 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2f250>
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/16.jpg saved to cache
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d16d50>
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/17.jpg saved to cache
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/18.jpg not downloaded yet
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/19.jpg not downloaded yet
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e35690>
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/15.jpg saved to cache
2026-01-28 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a8f10>
2026-01-28 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/10.jpg saved to cache
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/20.jpg not downloaded yet
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [ayvens.be] INFO: Found listing with ID: 1878709
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878709%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [ayvens.be] INFO: Scrape type for 1878709: 1
2026-01-28 20:17:48 [ayvens.be] INFO: Extracting data for car ID: 1878709
2026-01-28 20:17:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab with identifier: 1878709
2026-01-28 20:17:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab with scrape type 1
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/1.jpg not downloaded yet
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/2.jpg not downloaded yet
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/3.jpg not downloaded yet
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/4.jpg not downloaded yet
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/5.jpg not downloaded yet
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/6.jpg not downloaded yet
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd2c10>
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/3.jpg saved to cache
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e88150>
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/2.jpg saved to cache
2026-01-28 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f350>
2026-01-28 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/4.jpg saved to cache
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/7.jpg not downloaded yet
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/8.jpg not downloaded yet
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/9.jpg not downloaded yet
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4d110>
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/7.jpg saved to cache
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb6690>
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/1.jpg saved to cache
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d64350>
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/8.jpg saved to cache
2026-01-28 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eb5a90>
2026-01-28 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/6.jpg saved to cache
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4d9d0>
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/5.jpg saved to cache
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/10.jpg not downloaded yet
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/11.jpg not downloaded yet
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/12.jpg not downloaded yet
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/13.jpg not downloaded yet
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/14.jpg not downloaded yet
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/15.jpg not downloaded yet
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/16.jpg not downloaded yet
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/17.jpg not downloaded yet
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e62b50>
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/11.jpg saved to cache
2026-01-28 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c68310>
2026-01-28 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/10.jpg saved to cache
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/18.jpg not downloaded yet
2026-01-28 20:17:51 [ayvens.be] INFO: Found listing with ID: 1878710
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878710%27 HTTP/1.1" 200 None
2026-01-28 20:17:51 [ayvens.be] INFO: Scrape type for 1878710: 1
2026-01-28 20:17:51 [ayvens.be] INFO: Extracting data for car ID: 1878710
2026-01-28 20:17:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d544c043-f615-5b55-ae09-54ba69554e88 with identifier: 1878710
2026-01-28 20:17:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d544c043-f615-5b55-ae09-54ba69554e88 with scrape type 1
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/1.jpg not downloaded yet
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/2.jpg not downloaded yet
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e26790>
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/14.jpg saved to cache
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46b90>
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/13.jpg saved to cache
2026-01-28 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2a7d0>
2026-01-28 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/12.jpg saved to cache
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c590>
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F065d8675f8b94760ae6231974f5fc5a0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/7.jpg saved to cache
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48
2026-01-28 20:17:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48, skipping ID generation
2026-01-28 20:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with scrape type 1
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 from tracking dictionaries
2026-01-28 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 sending to next pipeline
2026-01-28 20:17:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48, identifier: 1878707
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a44610>
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/9.jpg saved to cache
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37250>
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/8.jpg saved to cache
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with identifier: 1878707
2026-01-28 20:17:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with identifier: 1878707
2026-01-28 20:17:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 19f87f50-9bd6-5ec4-baf2-5766a4dd1f48 with identifier: 1878707 to the API
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:17:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '19f87f50-9bd6-5ec4-baf2-5766a4dd1f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 111764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647370,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691696,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 581325,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 473280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555956,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626223,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675716,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602350,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549463,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f87f50-9bd6-5ec4-baf2-5766a4dd1f48/19f87f50-9bd6-5ec4-baf2-5766a4dd1f48_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/065d8675f8b94760ae6231974f5fc5a0/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T3 R-Design Geartronic',
 'transmission': 'automatic',
 'trim': '1.5 T3 R-Design Geartronic',
 'vin': None,
 'year': 2021}
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878707%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [ayvens.be] INFO: Saving data for 1878707: {'created_time': 1769631473.73516, 'last_price_update_time': 1769631473.735168, 'auction_closing_time': 1770107400.0}
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878707') HTTP/1.1" 204 0
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/3.jpg not downloaded yet
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/4.jpg not downloaded yet
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/5.jpg not downloaded yet
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/6.jpg not downloaded yet
2026-01-28 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/7.jpg not downloaded yet
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcdd50>
2026-01-28 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/20.jpg saved to cache
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/8.jpg not downloaded yet
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/9.jpg not downloaded yet
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f14b90>
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/1.jpg saved to cache
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce8390>
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/5.jpg saved to cache
2026-01-28 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9f10>
2026-01-28 20:17:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/4.jpg saved to cache
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de90d0>
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/7.jpg saved to cache
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cea510>
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/18.jpg saved to cache
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ced090>
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/6.jpg saved to cache
2026-01-28 20:17:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cebf90>
2026-01-28 20:17:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/19.jpg saved to cache
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/10.jpg not downloaded yet
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/11.jpg not downloaded yet
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/12.jpg not downloaded yet
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/13.jpg not downloaded yet
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/14.jpg not downloaded yet
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/15.jpg not downloaded yet
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/16.jpg not downloaded yet
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/17.jpg not downloaded yet
2026-01-28 20:17:56 [ayvens.be] INFO: Found listing with ID: 1878711
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878711%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [ayvens.be] INFO: Scrape type for 1878711: 1
2026-01-28 20:17:56 [ayvens.be] INFO: Extracting data for car ID: 1878711
2026-01-28 20:17:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 438df092-3955-53b0-bfd0-11311bedbf20 with identifier: 1878711
2026-01-28 20:17:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438df092-3955-53b0-bfd0-11311bedbf20 with scrape type 1
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/1.jpg not downloaded yet
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86050>
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/3.jpg saved to cache
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/2.jpg not downloaded yet
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f61e90>
2026-01-28 20:17:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/10.jpg saved to cache
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeab90>
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/12.jpg saved to cache
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec8e10>
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/17.jpg saved to cache
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4abd0>
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/18.jpg saved to cache
2026-01-28 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4a550>
2026-01-28 20:17:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:17:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/11.jpg saved to cache
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/3.jpg not downloaded yet
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffbc50>
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/9.jpg saved to cache
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eebd90>
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/8.jpg saved to cache
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/4.jpg not downloaded yet
2026-01-28 20:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/5.jpg not downloaded yet
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f636d0>
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/4.jpg saved to cache
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e650>
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/3.jpg saved to cache
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48e50>
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/2.jpg saved to cache
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/6.jpg not downloaded yet
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/7.jpg not downloaded yet
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31aa410>
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/7.jpg saved to cache
2026-01-28 20:17:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43390>
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:17:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:17:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/1.jpg saved to cache
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40d50>
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/8.jpg saved to cache
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/8.jpg not downloaded yet
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/9.jpg not downloaded yet
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/10.jpg not downloaded yet
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea3c10>
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/16.jpg saved to cache
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcfb50>
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/11.jpg saved to cache
2026-01-28 20:18:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0dd0>
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/15.jpg saved to cache
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78710>
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/10.jpg saved to cache
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea0490>
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/5.jpg saved to cache
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7c310>
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/6.jpg saved to cache
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/11.jpg not downloaded yet
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/12.jpg not downloaded yet
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d59210>
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/9.jpg saved to cache
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/13.jpg not downloaded yet
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/14.jpg not downloaded yet
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/15.jpg not downloaded yet
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14290>
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/17.jpg saved to cache
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a290>
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/12.jpg saved to cache
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:02 [ayvens.be] INFO: Found listing with ID: 1878712
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878712%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [ayvens.be] INFO: Scrape type for 1878712: 1
2026-01-28 20:18:02 [ayvens.be] INFO: Extracting data for car ID: 1878712
2026-01-28 20:18:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38bf4ee0-1646-51eb-a58d-804d55308730 with identifier: 1878712
2026-01-28 20:18:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bf4ee0-1646-51eb-a58d-804d55308730 with scrape type 1
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/1.jpg not downloaded yet
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/2.jpg not downloaded yet
2026-01-28 20:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e07f90>
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/3.jpg saved to cache
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dee790>
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/1.jpg saved to cache
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ebb750>
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/16.jpg saved to cache
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd3a10>
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/15.jpg saved to cache
2026-01-28 20:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee3650>
2026-01-28 20:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/2.jpg saved to cache
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7c210>
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/14.jpg saved to cache
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/3.jpg not downloaded yet
2026-01-28 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/4.jpg not downloaded yet
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27250>
2026-01-28 20:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/5.jpg saved to cache
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/5.jpg not downloaded yet
2026-01-28 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/6.jpg not downloaded yet
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ca10>
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/4.jpg saved to cache
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c2d0>
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bt%252Fd33954e456df44c98a0104948d8f1fac%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/13.jpg saved to cache
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d544c043-f615-5b55-ae09-54ba69554e88
2026-01-28 20:18:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d544c043-f615-5b55-ae09-54ba69554e88, skipping ID generation
2026-01-28 20:18:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d544c043-f615-5b55-ae09-54ba69554e88 with scrape type 1
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d544c043-f615-5b55-ae09-54ba69554e88 from tracking dictionaries
2026-01-28 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d544c043-f615-5b55-ae09-54ba69554e88 sending to next pipeline
2026-01-28 20:18:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d544c043-f615-5b55-ae09-54ba69554e88, identifier: 1878710
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/7.jpg not downloaded yet
2026-01-28 20:18:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d544c043-f615-5b55-ae09-54ba69554e88 with identifier: 1878710
2026-01-28 20:18:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d544c043-f615-5b55-ae09-54ba69554e88 with identifier: 1878710
2026-01-28 20:18:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d544c043-f615-5b55-ae09-54ba69554e88 with identifier: 1878710 to the API
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'd544c043-f615-5b55-ae09-54ba69554e88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 99410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259970,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226824,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242927,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 161102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303605,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366700,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d544c043-f615-5b55-ae09-54ba69554e88/d544c043-f615-5b55-ae09-54ba69554e88_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bt/d33954e456df44c98a0104948d8f1fac/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878710%27 HTTP/1.1" 200 None
2026-01-28 20:18:06 [ayvens.be] INFO: Saving data for 1878710: {'created_time': 1769631486.696769, 'last_price_update_time': 1769631486.696779, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878710') HTTP/1.1" 204 0
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/8.jpg not downloaded yet
2026-01-28 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/9.jpg not downloaded yet
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff1dd0>
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/2.jpg saved to cache
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e37550>
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/14.jpg saved to cache
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cce250>
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/6.jpg saved to cache
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e9b110>
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yt%252F62b2141239314fe9809780180ee8f76e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/13.jpg saved to cache
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab
2026-01-28 20:18:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab, skipping ID generation
2026-01-28 20:18:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab with scrape type 1
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab from tracking dictionaries
2026-01-28 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 864f4c38-70ad-5ebc-ad9a-912ea5a682ab sending to next pipeline
2026-01-28 20:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab, identifier: 1878709
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9310>
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/7.jpg saved to cache
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab with identifier: 1878709
2026-01-28 20:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab with identifier: 1878709
2026-01-28 20:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab spider: ayvens.be
2026-01-28 20:18:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 864f4c38-70ad-5ebc-ad9a-912ea5a682ab due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '864f4c38-70ad-5ebc-ad9a-912ea5a682ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 91963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463760,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471381,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486293,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721229,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 771826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 820151,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 595502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611848,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571922,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519208,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_864f4c38-70ad-5ebc-ad9a-912ea5a682ab/864f4c38-70ad-5ebc-ad9a-912ea5a682ab_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577902,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yt/62b2141239314fe9809780180ee8f76e/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2020}
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878709%27 HTTP/1.1" 200 None
2026-01-28 20:18:08 [ayvens.be] INFO: Saving data for 1878709: {'created_time': 1769631488.485988, 'last_price_update_time': 1769631488.486, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878709') HTTP/1.1" 204 0
2026-01-28 20:18:08 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 0 pages/min), scraped 68 items (at 7 items/min)
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/10.jpg not downloaded yet
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/11.jpg not downloaded yet
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f06fd0>
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/10.jpg saved to cache
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/12.jpg not downloaded yet
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/13.jpg not downloaded yet
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e25050>
2026-01-28 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/12.jpg saved to cache
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c58410>
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/9.jpg saved to cache
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30ea850>
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/11.jpg saved to cache
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/14.jpg not downloaded yet
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/15.jpg not downloaded yet
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e91a50>
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/17.jpg saved to cache
2026-01-28 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a9310>
2026-01-28 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/16.jpg saved to cache
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e57590>
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F5273c958d93b4723aec77548c6f182f9%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/15.jpg saved to cache
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 679989ed-9c17-5dbc-a99d-87aeb985a708
2026-01-28 20:18:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 679989ed-9c17-5dbc-a99d-87aeb985a708, skipping ID generation
2026-01-28 20:18:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679989ed-9c17-5dbc-a99d-87aeb985a708 with scrape type 1
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 679989ed-9c17-5dbc-a99d-87aeb985a708 from tracking dictionaries
2026-01-28 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 679989ed-9c17-5dbc-a99d-87aeb985a708 sending to next pipeline
2026-01-28 20:18:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 679989ed-9c17-5dbc-a99d-87aeb985a708, identifier: 1878708
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25810>
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/8.jpg saved to cache
2026-01-28 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/16.jpg not downloaded yet
2026-01-28 20:18:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 679989ed-9c17-5dbc-a99d-87aeb985a708 with identifier: 1878708
2026-01-28 20:18:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 679989ed-9c17-5dbc-a99d-87aeb985a708 with identifier: 1878708
2026-01-28 20:18:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 679989ed-9c17-5dbc-a99d-87aeb985a708 with identifier: 1878708 to the API
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '679989ed-9c17-5dbc-a99d-87aeb985a708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 84408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 714102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741241,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686245,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 747680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651419,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 931778,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 928102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600099,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673486,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703453,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617176,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 904550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_679989ed-9c17-5dbc-a99d-87aeb985a708/679989ed-9c17-5dbc-a99d-87aeb985a708_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/5273c958d93b4723aec77548c6f182f9/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878708%27 HTTP/1.1" 200 None
2026-01-28 20:18:11 [ayvens.be] INFO: Saving data for 1878708: {'created_time': 1769631491.819412, 'last_price_update_time': 1769631491.819421, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878708') HTTP/1.1" 204 0
2026-01-28 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/17.jpg not downloaded yet
2026-01-28 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/18.jpg not downloaded yet
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d72b10>
2026-01-28 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/1.jpg saved to cache
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/19.jpg not downloaded yet
2026-01-28 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/20.jpg not downloaded yet
2026-01-28 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb77d0>
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/3.jpg saved to cache
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e2350>
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/2.jpg saved to cache
2026-01-28 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e8a10>
2026-01-28 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/15.jpg saved to cache
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2f510>
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/4.jpg saved to cache
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:13 [ayvens.be] INFO: Found listing with ID: 1878713
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878713%27 HTTP/1.1" 200 None
2026-01-28 20:18:13 [ayvens.be] INFO: Scrape type for 1878713: 1
2026-01-28 20:18:13 [ayvens.be] INFO: Extracting data for car ID: 1878713
2026-01-28 20:18:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e38eefee-8e24-5816-9794-e387e918bc3c with identifier: 1878713
2026-01-28 20:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e38eefee-8e24-5816-9794-e387e918bc3c with scrape type 1
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/1.jpg not downloaded yet
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/2.jpg not downloaded yet
2026-01-28 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/3.jpg not downloaded yet
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec6710>
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/13.jpg saved to cache
2026-01-28 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f83ed0>
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bp%252F39f163fc9bf6400085fbb113481badd7%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/14.jpg saved to cache
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 438df092-3955-53b0-bfd0-11311bedbf20
2026-01-28 20:18:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 438df092-3955-53b0-bfd0-11311bedbf20, skipping ID generation
2026-01-28 20:18:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 438df092-3955-53b0-bfd0-11311bedbf20 with scrape type 1
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 438df092-3955-53b0-bfd0-11311bedbf20 from tracking dictionaries
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 438df092-3955-53b0-bfd0-11311bedbf20 sending to next pipeline
2026-01-28 20:18:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 438df092-3955-53b0-bfd0-11311bedbf20, identifier: 1878711
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb6790>
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/12.jpg saved to cache
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:18:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 438df092-3955-53b0-bfd0-11311bedbf20 with identifier: 1878711
2026-01-28 20:18:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 438df092-3955-53b0-bfd0-11311bedbf20 with identifier: 1878711
2026-01-28 20:18:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 438df092-3955-53b0-bfd0-11311bedbf20 with identifier: 1878711 to the API
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '438df092-3955-53b0-bfd0-11311bedbf20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 62431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644373,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 669224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545164,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557482,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607444,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691650,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508924,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 505813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435313,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537895,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_438df092-3955-53b0-bfd0-11311bedbf20/438df092-3955-53b0-bfd0-11311bedbf20_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 516925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bp/39f163fc9bf6400085fbb113481badd7/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ADVANCED AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ADVANCED AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878711%27 HTTP/1.1" 200 None
2026-01-28 20:18:14 [ayvens.be] INFO: Saving data for 1878711: {'created_time': 1769631494.785801, 'last_price_update_time': 1769631494.785811, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878711') HTTP/1.1" 204 0
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/4.jpg not downloaded yet
2026-01-28 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/5.jpg not downloaded yet
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05ed0>
2026-01-28 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/8.jpg saved to cache
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/6.jpg not downloaded yet
2026-01-28 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/7.jpg not downloaded yet
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c58dd0>
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/9.jpg saved to cache
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb6350>
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/10.jpg saved to cache
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8ed10>
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/11.jpg saved to cache
2026-01-28 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/8.jpg not downloaded yet
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/9.jpg not downloaded yet
2026-01-28 20:18:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8e890>
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/7.jpg saved to cache
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37790>
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/12.jpg saved to cache
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/10.jpg not downloaded yet
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/11.jpg not downloaded yet
2026-01-28 20:18:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/12.jpg not downloaded yet
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6d410>
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/5.jpg saved to cache
2026-01-28 20:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f31610>
2026-01-28 20:18:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/6.jpg saved to cache
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82890>
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/13.jpg saved to cache
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/13.jpg not downloaded yet
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/14.jpg not downloaded yet
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8fdf0d0>
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/15.jpg saved to cache
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/15.jpg not downloaded yet
2026-01-28 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/16.jpg not downloaded yet
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/17.jpg not downloaded yet
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d550>
2026-01-28 20:18:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/16.jpg saved to cache
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76950>
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/17.jpg saved to cache
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42490>
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/19.jpg saved to cache
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b40e10>
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/18.jpg saved to cache
2026-01-28 20:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0b90>
2026-01-28 20:18:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/14.jpg saved to cache
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/18.jpg not downloaded yet
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec7d0>
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/11.jpg saved to cache
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/19.jpg not downloaded yet
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/20.jpg not downloaded yet
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f690>
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/2.jpg saved to cache
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [ayvens.be] INFO: Found listing with ID: 1878714
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878714%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [ayvens.be] INFO: Scrape type for 1878714: 1
2026-01-28 20:18:19 [ayvens.be] INFO: Extracting data for car ID: 1878714
2026-01-28 20:18:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with identifier: 1878714
2026-01-28 20:18:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with scrape type 1
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/1.jpg not downloaded yet
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/2.jpg not downloaded yet
2026-01-28 20:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65750>
2026-01-28 20:18:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/3.jpg saved to cache
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/3.jpg not downloaded yet
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/4.jpg not downloaded yet
2026-01-28 20:18:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/5.jpg not downloaded yet
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7a850>
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/1.jpg saved to cache
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8c550>
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bn%252F473532f70810466490a4ca587cf317a9%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/20.jpg saved to cache
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 38bf4ee0-1646-51eb-a58d-804d55308730
2026-01-28 20:18:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38bf4ee0-1646-51eb-a58d-804d55308730, skipping ID generation
2026-01-28 20:18:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bf4ee0-1646-51eb-a58d-804d55308730 with scrape type 1
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 38bf4ee0-1646-51eb-a58d-804d55308730 from tracking dictionaries
2026-01-28 20:18:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38bf4ee0-1646-51eb-a58d-804d55308730 sending to next pipeline
2026-01-28 20:18:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 38bf4ee0-1646-51eb-a58d-804d55308730, identifier: 1878712
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec190>
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/7.jpg saved to cache
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07090>
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/4.jpg saved to cache
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5490>
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/5.jpg saved to cache
2026-01-28 20:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 38bf4ee0-1646-51eb-a58d-804d55308730 with identifier: 1878712
2026-01-28 20:18:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 38bf4ee0-1646-51eb-a58d-804d55308730 with identifier: 1878712
2026-01-28 20:18:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 38bf4ee0-1646-51eb-a58d-804d55308730 with identifier: 1878712 to the API
2026-01-28 20:18:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '38bf4ee0-1646-51eb-a58d-804d55308730',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'CITROËN',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 67550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521438,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 501030,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539282,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536929,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640960,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834884,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653677,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536623,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583250,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bf4ee0-1646-51eb-a58d-804d55308730/38bf4ee0-1646-51eb-a58d-804d55308730_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bn/473532f70810466490a4ca587cf317a9/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROËN GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878712%27 HTTP/1.1" 200 None
2026-01-28 20:18:22 [ayvens.be] INFO: Saving data for 1878712: {'created_time': 1769631502.245075, 'last_price_update_time': 1769631502.245084, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878712') HTTP/1.1" 204 0
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/6.jpg not downloaded yet
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/7.jpg not downloaded yet
2026-01-28 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3c910>
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/6.jpg saved to cache
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f839d0>
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/8.jpg saved to cache
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/8.jpg not downloaded yet
2026-01-28 20:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/9.jpg not downloaded yet
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d4d0>
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/12.jpg saved to cache
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25550>
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/10.jpg saved to cache
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65010>
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/11.jpg saved to cache
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/10.jpg not downloaded yet
2026-01-28 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/11.jpg not downloaded yet
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfa110>
2026-01-28 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/9.jpg saved to cache
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc2c90>
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/13.jpg saved to cache
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/12.jpg not downloaded yet
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/13.jpg not downloaded yet
2026-01-28 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/14.jpg not downloaded yet
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25f50>
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F9c30961b1f9645a5bcdfe531f19a59c5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/2.jpg saved to cache
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf
2026-01-28 20:18:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf, skipping ID generation
2026-01-28 20:18:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with scrape type 1
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf from tracking dictionaries
2026-01-28 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf sending to next pipeline
2026-01-28 20:18:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf, identifier: 1878706
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37050>
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/17.jpg saved to cache
2026-01-28 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1c990>
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/14.jpg saved to cache
2026-01-28 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with identifier: 1878706
2026-01-28 20:18:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with identifier: 1878706
2026-01-28 20:18:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf with identifier: 1878706 to the API
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 50608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611420,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656170,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634260,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598516,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 703731,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 457705,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 469056,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 689741,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531680,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522115,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf/9ac8c73b-e8f3-5f62-afa6-dd313dfb62bf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/9c30961b1f9645a5bcdfe531f19a59c5/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318DA (100KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318DA (100KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878706%27 HTTP/1.1" 200 None
2026-01-28 20:18:26 [ayvens.be] INFO: Saving data for 1878706: {'created_time': 1769631506.053922, 'last_price_update_time': 1769631506.053932, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878706') HTTP/1.1" 204 0
2026-01-28 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/15.jpg not downloaded yet
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/16.jpg not downloaded yet
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e76610>
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/19.jpg saved to cache
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6c6d0>
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/18.jpg saved to cache
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e926d0>
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/20.jpg saved to cache
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/17.jpg not downloaded yet
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/18.jpg not downloaded yet
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49cd0>
2026-01-28 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/15.jpg saved to cache
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0850>
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2at%252Fe0e7e03fbcdc4517b641c2f986e1109c%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/16.jpg saved to cache
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item e38eefee-8e24-5816-9794-e387e918bc3c
2026-01-28 20:18:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e38eefee-8e24-5816-9794-e387e918bc3c, skipping ID generation
2026-01-28 20:18:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e38eefee-8e24-5816-9794-e387e918bc3c with scrape type 1
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e38eefee-8e24-5816-9794-e387e918bc3c from tracking dictionaries
2026-01-28 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e38eefee-8e24-5816-9794-e387e918bc3c sending to next pipeline
2026-01-28 20:18:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e38eefee-8e24-5816-9794-e387e918bc3c, identifier: 1878713
2026-01-28 20:18:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e38eefee-8e24-5816-9794-e387e918bc3c with identifier: 1878713
2026-01-28 20:18:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e38eefee-8e24-5816-9794-e387e918bc3c with identifier: 1878713
2026-01-28 20:18:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e38eefee-8e24-5816-9794-e387e918bc3c with identifier: 1878713 to the API
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e38eefee-8e24-5816-9794-e387e918bc3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 88490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651449,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705489,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651459,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707469,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582688,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580273,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 528077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579995,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579896,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670881,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699544,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679077,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 584936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619674,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e38eefee-8e24-5816-9794-e387e918bc3c/e38eefee-8e24-5816-9794-e387e918bc3c_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644509,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2at/e0e7e03fbcdc4517b641c2f986e1109c/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 2.0 CLA 200 D BUSINESS SOLUTION '
          'LIM DCT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 200 D BUSINESS SOLUTION LIM DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878713%27 HTTP/1.1" 200 None
2026-01-28 20:18:27 [ayvens.be] INFO: Saving data for 1878713: {'created_time': 1769631507.977669, 'last_price_update_time': 1769631507.977678, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878713') HTTP/1.1" 204 0
2026-01-28 20:18:27 [ayvens.be] INFO: Found listing with ID: 1878715
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878715%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [ayvens.be] INFO: Scrape type for 1878715: 1
2026-01-28 20:18:28 [ayvens.be] INFO: Extracting data for car ID: 1878715
2026-01-28 20:18:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34369e2c-9e33-5b49-843a-883397fd4193 with identifier: 1878715
2026-01-28 20:18:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34369e2c-9e33-5b49-843a-883397fd4193 with scrape type 1
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/1.jpg not downloaded yet
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/2.jpg not downloaded yet
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d16d50>
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/2.jpg saved to cache
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d64910>
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/1.jpg saved to cache
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/3.jpg not downloaded yet
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/4.jpg not downloaded yet
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5e9d0>
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/4.jpg saved to cache
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/5.jpg not downloaded yet
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/6.jpg not downloaded yet
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c64210>
2026-01-28 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/6.jpg saved to cache
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f32bd0>
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/5.jpg saved to cache
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbed10>
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/3.jpg saved to cache
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/7.jpg not downloaded yet
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/8.jpg not downloaded yet
2026-01-28 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/9.jpg not downloaded yet
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef0090>
2026-01-28 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/7.jpg saved to cache
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee0ed0>
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/4.jpg saved to cache
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/10.jpg not downloaded yet
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/11.jpg not downloaded yet
2026-01-28 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c2db90>
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/9.jpg saved to cache
2026-01-28 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1e50>
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/8.jpg saved to cache
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cae910>
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/10.jpg saved to cache
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/12.jpg not downloaded yet
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/13.jpg not downloaded yet
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/14.jpg not downloaded yet
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0c9d0>
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/13.jpg saved to cache
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/15.jpg not downloaded yet
2026-01-28 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:31 [ayvens.be] INFO: Found listing with ID: 1878716
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878716%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [ayvens.be] INFO: Scrape type for 1878716: 1
2026-01-28 20:18:31 [ayvens.be] INFO: Extracting data for car ID: 1878716
2026-01-28 20:18:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with identifier: 1878716
2026-01-28 20:18:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with scrape type 1
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/1.jpg not downloaded yet
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8d390>
2026-01-28 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yv%252F6b69d7dec1f243eca23b6f824f85e2a8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/1.jpg saved to cache
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff
2026-01-28 20:18:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff, skipping ID generation
2026-01-28 20:18:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with scrape type 1
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff from tracking dictionaries
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff sending to next pipeline
2026-01-28 20:18:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff, identifier: 1878705
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c48fd0>
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/12.jpg saved to cache
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a8dd0>
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/14.jpg saved to cache
2026-01-28 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f38250>
2026-01-28 20:18:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/11.jpg saved to cache
2026-01-28 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1f3d0>
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/16.jpg saved to cache
2026-01-28 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/2.jpg not downloaded yet
2026-01-28 20:18:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with identifier: 1878705
2026-01-28 20:18:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with identifier: 1878705
2026-01-28 20:18:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff with identifier: 1878705 to the API
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 93266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614454,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636588,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681978,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638503,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 725046,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570356,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 784734,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705556,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663390,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610100,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608425,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601026,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535577,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538125,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff/a037cbd6-4d00-5fd9-9183-6c3b8d2c21ff_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yv/6b69d7dec1f243eca23b6f824f85e2a8/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 2.0 dA sDrive18 AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 dA sDrive18 AdBlue',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878705%27 HTTP/1.1" 200 None
2026-01-28 20:18:34 [ayvens.be] INFO: Saving data for 1878705: {'created_time': 1769631514.001044, 'last_price_update_time': 1769631514.001054, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878705') HTTP/1.1" 204 0
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/3.jpg not downloaded yet
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/4.jpg not downloaded yet
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f18550>
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/15.jpg saved to cache
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a9b90>
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/18.jpg saved to cache
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/5.jpg not downloaded yet
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/6.jpg not downloaded yet
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4aa50>
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/2.jpg saved to cache
2026-01-28 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f80110>
2026-01-28 20:18:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/3.jpg saved to cache
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/7.jpg not downloaded yet
2026-01-28 20:18:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/8.jpg not downloaded yet
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/9.jpg not downloaded yet
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8fc50>
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ft%252Fd8f8a337bd224d36bd1b7fe8175138de%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/17.jpg saved to cache
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5
2026-01-28 20:18:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ab80d26-0ecb-5414-82e9-31d805eb19e5, skipping ID generation
2026-01-28 20:18:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with scrape type 1
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1ab80d26-0ecb-5414-82e9-31d805eb19e5 from tracking dictionaries
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ab80d26-0ecb-5414-82e9-31d805eb19e5 sending to next pipeline
2026-01-28 20:18:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1ab80d26-0ecb-5414-82e9-31d805eb19e5, identifier: 1878714
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5c850>
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/1.jpg saved to cache
2026-01-28 20:18:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66790>
2026-01-28 20:18:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/4.jpg saved to cache
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0c1d0>
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/7.jpg saved to cache
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1fb90>
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/6.jpg saved to cache
2026-01-28 20:18:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with identifier: 1878714
2026-01-28 20:18:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with identifier: 1878714
2026-01-28 20:18:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1ab80d26-0ecb-5414-82e9-31d805eb19e5 with identifier: 1878714 to the API
2026-01-28 20:18:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/17.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1ab80d26-0ecb-5414-82e9-31d805eb19e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 26409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606772,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625749,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582384,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806948,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678710,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 814017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 808201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705706,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 534388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715214,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647919,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ab80d26-0ecb-5414-82e9-31d805eb19e5/1ab80d26-0ecb-5414-82e9-31d805eb19e5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 518802,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ft/d8f8a337bd224d36bd1b7fe8175138de/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T 100 PULSE DCT',
 'transmission': 'automatic',
 'trim': '1.0 T 100 PULSE DCT',
 'vin': None,
 'year': 2024}
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878714%27 HTTP/1.1" 200 None
2026-01-28 20:18:37 [ayvens.be] INFO: Saving data for 1878714: {'created_time': 1769631517.256464, 'last_price_update_time': 1769631517.256475, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878714') HTTP/1.1" 204 0
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/10.jpg not downloaded yet
2026-01-28 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/11.jpg not downloaded yet
2026-01-28 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de7f90>
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/8.jpg saved to cache
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/12.jpg not downloaded yet
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/13.jpg not downloaded yet
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee9a10>
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/9.jpg saved to cache
2026-01-28 20:18:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb45d0>
2026-01-28 20:18:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/12.jpg saved to cache
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3790>
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/5.jpg saved to cache
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/14.jpg not downloaded yet
2026-01-28 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/15.jpg not downloaded yet
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c25b10>
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/10.jpg saved to cache
2026-01-28 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9b910>
2026-01-28 20:18:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/11.jpg saved to cache
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/16.jpg not downloaded yet
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/17.jpg not downloaded yet
2026-01-28 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/18.jpg not downloaded yet
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6fbd0>
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/15.jpg saved to cache
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3d90>
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/14.jpg saved to cache
2026-01-28 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8c07850>
2026-01-28 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ee%252F31c66861189d4c00a772e43722427c64%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/13.jpg saved to cache
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 34369e2c-9e33-5b49-843a-883397fd4193
2026-01-28 20:18:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34369e2c-9e33-5b49-843a-883397fd4193, skipping ID generation
2026-01-28 20:18:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34369e2c-9e33-5b49-843a-883397fd4193 with scrape type 1
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 34369e2c-9e33-5b49-843a-883397fd4193 from tracking dictionaries
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34369e2c-9e33-5b49-843a-883397fd4193 sending to next pipeline
2026-01-28 20:18:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 34369e2c-9e33-5b49-843a-883397fd4193, identifier: 1878715
2026-01-28 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 34369e2c-9e33-5b49-843a-883397fd4193 with identifier: 1878715
2026-01-28 20:18:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 34369e2c-9e33-5b49-843a-883397fd4193 with identifier: 1878715
2026-01-28 20:18:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 34369e2c-9e33-5b49-843a-883397fd4193 with identifier: 1878715 to the API
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '34369e2c-9e33-5b49-843a-883397fd4193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 30162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577155,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535061,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525522,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554826,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603018,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479600,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598630,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 504580,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667218,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34369e2c-9e33-5b49-843a-883397fd4193/34369e2c-9e33-5b49-843a-883397fd4193_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ee/31c66861189d4c00a772e43722427c64/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ALLURE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ALLURE',
 'vin': None,
 'year': 2023}
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878715%27 HTTP/1.1" 200 None
2026-01-28 20:18:40 [ayvens.be] INFO: Saving data for 1878715: {'created_time': 1769631520.690983, 'last_price_update_time': 1769631520.690992, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878715') HTTP/1.1" 204 0
2026-01-28 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/19.jpg not downloaded yet
2026-01-28 20:18:40 [ayvens.be] INFO: Found listing with ID: 1878717
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878717%27 HTTP/1.1" 200 None
2026-01-28 20:18:40 [ayvens.be] INFO: Scrape type for 1878717: 1
2026-01-28 20:18:40 [ayvens.be] INFO: Extracting data for car ID: 1878717
2026-01-28 20:18:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c345767d-6895-556e-91e7-965d509236f2 with identifier: 1878717
2026-01-28 20:18:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c345767d-6895-556e-91e7-965d509236f2 with scrape type 1
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/1.jpg not downloaded yet
2026-01-28 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8e890>
2026-01-28 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/2.jpg saved to cache
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc1e10>
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/4.jpg saved to cache
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61650>
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/3.jpg saved to cache
2026-01-28 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66710>
2026-01-28 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/1.jpg saved to cache
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/2.jpg not downloaded yet
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/3.jpg not downloaded yet
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e390>
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bj%252F31c4b5849c664e18b9731a58701c3de7%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/20.jpg saved to cache
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66
2026-01-28 20:18:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7598c6cb-ff7d-5c2f-84a5-df466b757e66, skipping ID generation
2026-01-28 20:18:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with scrape type 1
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7598c6cb-ff7d-5c2f-84a5-df466b757e66 from tracking dictionaries
2026-01-28 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7598c6cb-ff7d-5c2f-84a5-df466b757e66 sending to next pipeline
2026-01-28 20:18:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7598c6cb-ff7d-5c2f-84a5-df466b757e66, identifier: 1878704
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8eb10>
2026-01-28 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/5.jpg saved to cache
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with identifier: 1878704
2026-01-28 20:18:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with identifier: 1878704
2026-01-28 20:18:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7598c6cb-ff7d-5c2f-84a5-df466b757e66 with identifier: 1878704 to the API
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '7598c6cb-ff7d-5c2f-84a5-df466b757e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQA',
 'odometer': 70675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655076,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679621,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664340,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636109,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662942,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695028,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664126,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 453505,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526287,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7598c6cb-ff7d-5c2f-84a5-df466b757e66/7598c6cb-ff7d-5c2f-84a5-df466b757e66_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704140,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bj/31c4b5849c664e18b9731a58701c3de7/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQA BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'transmission': 'automatic',
 'trim': 'BEV 67KWH EQA 250 BUSINESS SOLUTION LUX',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878704%27 HTTP/1.1" 200 None
2026-01-28 20:18:43 [ayvens.be] INFO: Saving data for 1878704: {'created_time': 1769631523.429005, 'last_price_update_time': 1769631523.429015, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878704') HTTP/1.1" 204 0
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/4.jpg not downloaded yet
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/5.jpg not downloaded yet
2026-01-28 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d23190>
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/9.jpg saved to cache
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/6.jpg not downloaded yet
2026-01-28 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/7.jpg not downloaded yet
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0fb50>
2026-01-28 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/7.jpg saved to cache
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def890>
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/10.jpg saved to cache
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/8.jpg not downloaded yet
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/9.jpg not downloaded yet
2026-01-28 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e566d0>
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/8.jpg saved to cache
2026-01-28 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5dc10>
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/9.jpg saved to cache
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5c910>
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/11.jpg saved to cache
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/10.jpg not downloaded yet
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/11.jpg not downloaded yet
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/12.jpg not downloaded yet
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8eb10>
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/6.jpg saved to cache
2026-01-28 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c6b0d0>
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/13.jpg saved to cache
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfb790>
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/12.jpg saved to cache
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/13.jpg not downloaded yet
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/14.jpg not downloaded yet
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/15.jpg not downloaded yet
2026-01-28 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:46 [ayvens.be] INFO: Found listing with ID: 1878718
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878718%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [ayvens.be] INFO: Scrape type for 1878718: 1
2026-01-28 20:18:46 [ayvens.be] INFO: Extracting data for car ID: 1878718
2026-01-28 20:18:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0d771c-06dc-5b61-99c3-afa605d917e3 with identifier: 1878718
2026-01-28 20:18:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0d771c-06dc-5b61-99c3-afa605d917e3 with scrape type 1
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/1.jpg not downloaded yet
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/2.jpg not downloaded yet
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f819d0>
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/17.jpg saved to cache
2026-01-28 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ed8310>
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/14.jpg saved to cache
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/3.jpg not downloaded yet
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a69c50>
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/18.jpg saved to cache
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f53fd0>
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/16.jpg saved to cache
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/4.jpg not downloaded yet
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f14790>
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/15.jpg saved to cache
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d73550>
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fx%252F1ce2ac777897435aa29183d77b285d65%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/19.jpg saved to cache
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782
2026-01-28 20:18:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782, skipping ID generation
2026-01-28 20:18:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with scrape type 1
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 from tracking dictionaries
2026-01-28 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 sending to next pipeline
2026-01-28 20:18:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782, identifier: 1878716
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec4710>
2026-01-28 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ax%252F514c1569ccef4e76b2b7afa07d4c15a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/7.jpg saved to cache
2026-01-28 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c5089f5-97e4-5462-a783-ca95d742caaa
2026-01-28 20:18:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c5089f5-97e4-5462-a783-ca95d742caaa, skipping ID generation
2026-01-28 20:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5089f5-97e4-5462-a783-ca95d742caaa with scrape type 1
2026-01-28 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c5089f5-97e4-5462-a783-ca95d742caaa from tracking dictionaries
2026-01-28 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c5089f5-97e4-5462-a783-ca95d742caaa sending to next pipeline
2026-01-28 20:18:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c5089f5-97e4-5462-a783-ca95d742caaa, identifier: 1878692
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/5.jpg not downloaded yet
2026-01-28 20:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with identifier: 1878716
2026-01-28 20:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with identifier: 1878716
2026-01-28 20:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8535bf21-b5c6-58f8-8bfb-b0e2cb274782 with identifier: 1878716 to the API
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8535bf21-b5c6-58f8-8bfb-b0e2cb274782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'STONIC',
 'odometer': 15471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 600120,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574388,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561732,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533801,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 777756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 819664,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 823908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632283,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726311,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578267,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591958,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 519628,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8535bf21-b5c6-58f8-8bfb-b0e2cb274782/8535bf21-b5c6-58f8-8bfb-b0e2cb274782_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fx/1ce2ac777897435aa29183d77b285d65/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA STONIC 1.0 T 100 PULSE DCT',
 'transmission': 'automatic',
 'trim': '1.0 T 100 PULSE DCT',
 'vin': None,
 'year': 2024}
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878716%27 HTTP/1.1" 200 None
2026-01-28 20:18:49 [ayvens.be] INFO: Saving data for 1878716: {'created_time': 1769631529.687713, 'last_price_update_time': 1769631529.687726, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878716') HTTP/1.1" 204 0
2026-01-28 20:18:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c5089f5-97e4-5462-a783-ca95d742caaa with identifier: 1878692
2026-01-28 20:18:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c5089f5-97e4-5462-a783-ca95d742caaa with identifier: 1878692
2026-01-28 20:18:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2c5089f5-97e4-5462-a783-ca95d742caaa with identifier: 1878692 to the API
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:18:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:18:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2c5089f5-97e4-5462-a783-ca95d742caaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 115814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633998,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746349,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668768,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696248,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644598,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613940,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 543735,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472084,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5089f5-97e4-5462-a783-ca95d742caaa/2c5089f5-97e4-5462-a783-ca95d742caaa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456129,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ax/514c1569ccef4e76b2b7afa07d4c15a9/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.2 PURETECH 130 S&S AUTO ACTIVE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 S&S AUTO ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878692%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [ayvens.be] INFO: Saving data for 1878692: {'created_time': 1769631530.063512, 'last_price_update_time': 1769631530.063523, 'auction_closing_time': 1770107400.0}
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878692') HTTP/1.1" 204 0
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f1bc10>
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/1.jpg saved to cache
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/6.jpg not downloaded yet
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/7.jpg not downloaded yet
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/8.jpg not downloaded yet
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/9.jpg not downloaded yet
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/10.jpg not downloaded yet
2026-01-28 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/11.jpg not downloaded yet
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/12.jpg not downloaded yet
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/13.jpg not downloaded yet
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cc9f10>
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/6.jpg saved to cache
2026-01-28 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b27850>
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/3.jpg saved to cache
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/14.jpg not downloaded yet
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cc8a50>
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/10.jpg saved to cache
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec5c90>
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/5.jpg saved to cache
2026-01-28 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ef3110>
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/7.jpg saved to cache
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/15.jpg not downloaded yet
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/16.jpg not downloaded yet
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e21d0>
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/4.jpg saved to cache
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30826d0>
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/2.jpg saved to cache
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5c850>
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/8.jpg saved to cache
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/17.jpg not downloaded yet
2026-01-28 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/18.jpg not downloaded yet
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [ayvens.be] INFO: Found listing with ID: 1878719
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878719%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [ayvens.be] INFO: Scrape type for 1878719: 1
2026-01-28 20:18:53 [ayvens.be] INFO: Extracting data for car ID: 1878719
2026-01-28 20:18:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with identifier: 1878719
2026-01-28 20:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with scrape type 1
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/1.jpg not downloaded yet
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/2.jpg not downloaded yet
2026-01-28 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/3.jpg not downloaded yet
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14e10>
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/12.jpg saved to cache
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/4.jpg not downloaded yet
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c51e50>
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/13.jpg saved to cache
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/5.jpg not downloaded yet
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/6.jpg not downloaded yet
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2caead0>
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/9.jpg saved to cache
2026-01-28 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc1bd0>
2026-01-28 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/14.jpg saved to cache
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcdcd0>
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/10.jpg saved to cache
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c78ed0>
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/11.jpg saved to cache
2026-01-28 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2e190>
2026-01-28 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/3.jpg saved to cache
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b310>
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/9.jpg saved to cache
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/7.jpg not downloaded yet
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/8.jpg not downloaded yet
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/9.jpg not downloaded yet
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/10.jpg not downloaded yet
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/11.jpg not downloaded yet
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/12.jpg not downloaded yet
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/13.jpg not downloaded yet
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/14.jpg not downloaded yet
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f07610>
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/5.jpg saved to cache
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/15.jpg not downloaded yet
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e50dd0>
2026-01-28 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/7.jpg saved to cache
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e48c50>
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/4.jpg saved to cache
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea2e50>
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/14.jpg saved to cache
2026-01-28 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e52150>
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/2.jpg saved to cache
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f371d0>
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/1.jpg saved to cache
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:57 [ayvens.be] INFO: Found listing with ID: 1878720
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878720%27 HTTP/1.1" 200 None
2026-01-28 20:18:57 [ayvens.be] INFO: Scrape type for 1878720: 1
2026-01-28 20:18:57 [ayvens.be] INFO: Extracting data for car ID: 1878720
2026-01-28 20:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with identifier: 1878720
2026-01-28 20:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with scrape type 1
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/1.jpg not downloaded yet
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/2.jpg not downloaded yet
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3390>
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/6.jpg saved to cache
2026-01-28 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f5dc10>
2026-01-28 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/8.jpg saved to cache
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/3.jpg not downloaded yet
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/4.jpg not downloaded yet
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/5.jpg not downloaded yet
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/6.jpg not downloaded yet
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/7.jpg not downloaded yet
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/8.jpg not downloaded yet
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d48590>
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/16.jpg saved to cache
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/9.jpg not downloaded yet
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66f90>
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/15.jpg saved to cache
2026-01-28 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4b6d0>
2026-01-28 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/11.jpg saved to cache
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d94e90>
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/17.jpg saved to cache
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4cb90>
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/18.jpg saved to cache
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8f23dd0>
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/12.jpg saved to cache
2026-01-28 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de0cd0>
2026-01-28 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/13.jpg saved to cache
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/10.jpg not downloaded yet
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/11.jpg not downloaded yet
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3bc10>
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/1.jpg saved to cache
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/12.jpg not downloaded yet
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/13.jpg not downloaded yet
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/14.jpg not downloaded yet
2026-01-28 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/15.jpg not downloaded yet
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/16.jpg not downloaded yet
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/17.jpg not downloaded yet
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/18.jpg not downloaded yet
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c65110>
2026-01-28 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/5.jpg saved to cache
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:01 [ayvens.be] INFO: Found listing with ID: 1878721
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878721%27 HTTP/1.1" 200 None
2026-01-28 20:19:01 [ayvens.be] INFO: Scrape type for 1878721: 1
2026-01-28 20:19:01 [ayvens.be] INFO: Extracting data for car ID: 1878721
2026-01-28 20:19:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eef175f-9c45-536e-8892-b070e810e995 with identifier: 1878721
2026-01-28 20:19:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eef175f-9c45-536e-8892-b070e810e995 with scrape type 1
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/1.jpg not downloaded yet
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/2.jpg not downloaded yet
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/3.jpg not downloaded yet
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b53790>
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/14.jpg saved to cache
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b30d90>
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/7.jpg saved to cache
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c99390>
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/3.jpg saved to cache
2026-01-28 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b31c50>
2026-01-28 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/4.jpg saved to cache
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d52610>
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/8.jpg saved to cache
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6ee50>
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/15.jpg saved to cache
2026-01-28 20:19:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f53b90>
2026-01-28 20:19:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/6.jpg saved to cache
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/4.jpg not downloaded yet
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/5.jpg not downloaded yet
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/6.jpg not downloaded yet
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/7.jpg not downloaded yet
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/8.jpg not downloaded yet
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/9.jpg not downloaded yet
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c0be50>
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/13.jpg saved to cache
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/10.jpg not downloaded yet
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f39bd0>
2026-01-28 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/1.jpg saved to cache
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e5c2d0>
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/12.jpg saved to cache
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cec5d0>
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/4.jpg saved to cache
2026-01-28 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cedf90>
2026-01-28 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/3.jpg saved to cache
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/11.jpg not downloaded yet
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/12.jpg not downloaded yet
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab610>
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/11.jpg saved to cache
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d59450>
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/10.jpg saved to cache
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/13.jpg not downloaded yet
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/14.jpg not downloaded yet
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [ayvens.be] INFO: Found listing with ID: 1878722
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878722%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [ayvens.be] INFO: Scrape type for 1878722: 1
2026-01-28 20:19:05 [ayvens.be] INFO: Extracting data for car ID: 1878722
2026-01-28 20:19:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 with identifier: 1878722
2026-01-28 20:19:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 with scrape type 1
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/1.jpg not downloaded yet
2026-01-28 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/2.jpg not downloaded yet
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/3.jpg not downloaded yet
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/4.jpg not downloaded yet
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbed10>
2026-01-28 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/9.jpg saved to cache
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/5.jpg not downloaded yet
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ce9f50>
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/10.jpg saved to cache
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cce750>
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/11.jpg saved to cache
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/6.jpg not downloaded yet
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/7.jpg not downloaded yet
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fad290>
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/7.jpg saved to cache
2026-01-28 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1ce90>
2026-01-28 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/2.jpg saved to cache
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f82690>
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/12.jpg saved to cache
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e350>
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/13.jpg saved to cache
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e34810>
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/8.jpg saved to cache
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 0 pages/min), scraped 79 items (at 11 items/min)
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/8.jpg not downloaded yet
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/9.jpg not downloaded yet
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/10.jpg not downloaded yet
2026-01-28 20:19:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/11.jpg not downloaded yet
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/12.jpg not downloaded yet
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/13.jpg not downloaded yet
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df62d0>
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/3.jpg saved to cache
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/14.jpg not downloaded yet
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b13190>
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/1.jpg saved to cache
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/15.jpg not downloaded yet
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/16.jpg not downloaded yet
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20cd0>
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/17.jpg saved to cache
2026-01-28 20:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6ed50>
2026-01-28 20:19:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/5.jpg saved to cache
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8290>
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/18.jpg saved to cache
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e710>
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/16.jpg saved to cache
2026-01-28 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e91950>
2026-01-28 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/2.jpg saved to cache
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d97010>
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/4.jpg saved to cache
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/17.jpg not downloaded yet
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/18.jpg not downloaded yet
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [ayvens.be] INFO: Found listing with ID: 1878723
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878723%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [ayvens.be] INFO: Scrape type for 1878723: 1
2026-01-28 20:19:11 [ayvens.be] INFO: Extracting data for car ID: 1878723
2026-01-28 20:19:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with identifier: 1878723
2026-01-28 20:19:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with scrape type 1
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/1.jpg not downloaded yet
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/2.jpg not downloaded yet
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/3.jpg not downloaded yet
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/4.jpg not downloaded yet
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99110>
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/11.jpg saved to cache
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/5.jpg not downloaded yet
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e984d0>
2026-01-28 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/12.jpg saved to cache
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f288d0>
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/10.jpg saved to cache
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf3a50>
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/13.jpg saved to cache
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/6.jpg not downloaded yet
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee9b10>
2026-01-28 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/9.jpg saved to cache
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b69a90>
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/14.jpg saved to cache
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c67790>
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/8.jpg saved to cache
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f9a6d0>
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/5.jpg saved to cache
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/7.jpg not downloaded yet
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/8.jpg not downloaded yet
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/9.jpg not downloaded yet
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/10.jpg not downloaded yet
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/11.jpg not downloaded yet
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/12.jpg not downloaded yet
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/13.jpg not downloaded yet
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/14.jpg not downloaded yet
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/15.jpg not downloaded yet
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cedb10>
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/2.jpg saved to cache
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/16.jpg not downloaded yet
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b25fd0>
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/9.jpg saved to cache
2026-01-28 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f834d0>
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/3.jpg saved to cache
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceacd0>
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/1.jpg saved to cache
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/17.jpg not downloaded yet
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/18.jpg not downloaded yet
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7d890>
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/8.jpg saved to cache
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf1810>
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/4.jpg saved to cache
2026-01-28 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7e390>
2026-01-28 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/6.jpg saved to cache
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7d790>
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/7.jpg saved to cache
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/19.jpg not downloaded yet
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/20.jpg not downloaded yet
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:16 [ayvens.be] INFO: Found listing with ID: 1878724
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878724%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [ayvens.be] INFO: Scrape type for 1878724: 1
2026-01-28 20:19:16 [ayvens.be] INFO: Extracting data for car ID: 1878724
2026-01-28 20:19:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with identifier: 1878724
2026-01-28 20:19:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with scrape type 1
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/1.jpg not downloaded yet
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/2.jpg not downloaded yet
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e22ed0>
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/16.jpg saved to cache
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/3.jpg not downloaded yet
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/4.jpg not downloaded yet
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/5.jpg not downloaded yet
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e14c10>
2026-01-28 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/3.jpg saved to cache
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b74210>
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/2.jpg saved to cache
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d8d0d0>
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/15.jpg saved to cache
2026-01-28 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2cc90>
2026-01-28 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/5.jpg saved to cache
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b75750>
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/14.jpg saved to cache
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2ddd0>
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/17.jpg saved to cache
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4b7d0>
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/4.jpg saved to cache
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/6.jpg not downloaded yet
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/7.jpg not downloaded yet
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/8.jpg not downloaded yet
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/9.jpg not downloaded yet
2026-01-28 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/10.jpg not downloaded yet
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/11.jpg not downloaded yet
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/12.jpg not downloaded yet
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/13.jpg not downloaded yet
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/14.jpg not downloaded yet
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad3082c10>
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/16.jpg saved to cache
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eeac90>
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/18.jpg saved to cache
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/15.jpg not downloaded yet
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f62250>
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/17.jpg saved to cache
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea4b10>
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/6.jpg saved to cache
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ea7f10>
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/7.jpg saved to cache
2026-01-28 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc32d0>
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/8.jpg saved to cache
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8e07650>
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/1.jpg saved to cache
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:21 [ayvens.be] INFO: Found listing with ID: 1878725
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878725%27 HTTP/1.1" 200 None
2026-01-28 20:19:21 [ayvens.be] INFO: Scrape type for 1878725: 1
2026-01-28 20:19:21 [ayvens.be] INFO: Extracting data for car ID: 1878725
2026-01-28 20:19:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a492abab-07bf-5d8b-9618-f24142c5a470 with identifier: 1878725
2026-01-28 20:19:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a492abab-07bf-5d8b-9618-f24142c5a470 with scrape type 1
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/1.jpg not downloaded yet
2026-01-28 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/2.jpg not downloaded yet
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cd1d50>
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/9.jpg saved to cache
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/3.jpg not downloaded yet
2026-01-28 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/4.jpg not downloaded yet
2026-01-28 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6fd50>
2026-01-28 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/18.jpg saved to cache
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/5.jpg not downloaded yet
2026-01-28 20:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/6.jpg not downloaded yet
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/7.jpg not downloaded yet
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e74a90>
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/15.jpg saved to cache
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ec51d0>
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/14.jpg saved to cache
2026-01-28 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6ca90>
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/10.jpg saved to cache
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee08d0>
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/13.jpg saved to cache
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/8.jpg not downloaded yet
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/9.jpg not downloaded yet
2026-01-28 20:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22d90>
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/11.jpg saved to cache
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e45210>
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/19.jpg saved to cache
2026-01-28 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c6fd10>
2026-01-28 20:19:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/12.jpg saved to cache
2026-01-28 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/10.jpg not downloaded yet
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/11.jpg not downloaded yet
2026-01-28 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/12.jpg not downloaded yet
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ef77d0>
2026-01-28 20:19:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/6.jpg saved to cache
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/13.jpg not downloaded yet
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b8e310>
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/5.jpg saved to cache
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/14.jpg not downloaded yet
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31aab50>
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/14.jpg saved to cache
2026-01-28 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2da6390>
2026-01-28 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/13.jpg saved to cache
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f42ed0>
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/3.jpg saved to cache
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f43790>
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/15.jpg saved to cache
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/15.jpg not downloaded yet
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/16.jpg not downloaded yet
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edde10>
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/4.jpg saved to cache
2026-01-28 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8f232d0>
2026-01-28 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/7.jpg saved to cache
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/17.jpg not downloaded yet
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/18.jpg not downloaded yet
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/19.jpg not downloaded yet
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:27 [ayvens.be] INFO: Found listing with ID: 1878726
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878726%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [ayvens.be] INFO: Scrape type for 1878726: 1
2026-01-28 20:19:27 [ayvens.be] INFO: Extracting data for car ID: 1878726
2026-01-28 20:19:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7570669-31a1-5050-90a5-cf2166c8c7f1 with identifier: 1878726
2026-01-28 20:19:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7570669-31a1-5050-90a5-cf2166c8c7f1 with scrape type 1
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/1.jpg not downloaded yet
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/2.jpg not downloaded yet
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/3.jpg not downloaded yet
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbf590>
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/1.jpg saved to cache
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c7b9d0>
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/2.jpg saved to cache
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/4.jpg not downloaded yet
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/5.jpg not downloaded yet
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f63090>
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/3.jpg saved to cache
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e7ebd0>
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/12.jpg saved to cache
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9a990>
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/10.jpg saved to cache
2026-01-28 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30eb990>
2026-01-28 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/5.jpg saved to cache
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f60510>
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/11.jpg saved to cache
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fb7d10>
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/4.jpg saved to cache
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/6.jpg not downloaded yet
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/7.jpg not downloaded yet
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/8.jpg not downloaded yet
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/9.jpg not downloaded yet
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/10.jpg not downloaded yet
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/11.jpg not downloaded yet
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/12.jpg not downloaded yet
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c00e10>
2026-01-28 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/12.jpg saved to cache
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fad2d0>
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/10.jpg saved to cache
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e53c10>
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/9.jpg saved to cache
2026-01-28 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e606d0>
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/11.jpg saved to cache
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fad110>
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/7.jpg saved to cache
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/13.jpg not downloaded yet
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f19350>
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/6.jpg saved to cache
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8f2d0>
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/8.jpg saved to cache
2026-01-28 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7e390>
2026-01-28 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/9.jpg saved to cache
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/14.jpg not downloaded yet
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/15.jpg not downloaded yet
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/16.jpg not downloaded yet
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/17.jpg not downloaded yet
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/18.jpg not downloaded yet
2026-01-28 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:32 [ayvens.be] INFO: Found listing with ID: 1878727
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878727%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [ayvens.be] INFO: Scrape type for 1878727: 1
2026-01-28 20:19:32 [ayvens.be] INFO: Extracting data for car ID: 1878727
2026-01-28 20:19:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dcd7520-a081-518f-9974-188db7d9efc0 with identifier: 1878727
2026-01-28 20:19:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dcd7520-a081-518f-9974-188db7d9efc0 with scrape type 1
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/1.jpg not downloaded yet
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/2.jpg not downloaded yet
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d85950>
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/16.jpg saved to cache
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/3.jpg not downloaded yet
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e89c10>
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/15.jpg saved to cache
2026-01-28 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e6f850>
2026-01-28 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/17.jpg saved to cache
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/4.jpg not downloaded yet
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9a290>
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/14.jpg saved to cache
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3f5d0>
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/18.jpg saved to cache
2026-01-28 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f06510>
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/19.jpg saved to cache
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ee22d0>
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F121be10b475a46dcbb2d1f22c40dbd68%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/13.jpg saved to cache
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a492abab-07bf-5d8b-9618-f24142c5a470
2026-01-28 20:19:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a492abab-07bf-5d8b-9618-f24142c5a470, skipping ID generation
2026-01-28 20:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a492abab-07bf-5d8b-9618-f24142c5a470 with scrape type 1
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a492abab-07bf-5d8b-9618-f24142c5a470 from tracking dictionaries
2026-01-28 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a492abab-07bf-5d8b-9618-f24142c5a470 sending to next pipeline
2026-01-28 20:19:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a492abab-07bf-5d8b-9618-f24142c5a470, identifier: 1878725
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99ed0>
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/8.jpg saved to cache
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/5.jpg not downloaded yet
2026-01-28 20:19:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a492abab-07bf-5d8b-9618-f24142c5a470 with identifier: 1878725
2026-01-28 20:19:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a492abab-07bf-5d8b-9618-f24142c5a470 with identifier: 1878725
2026-01-28 20:19:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a492abab-07bf-5d8b-9618-f24142c5a470 with identifier: 1878725 to the API
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:19:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a492abab-07bf-5d8b-9618-f24142c5a470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 47510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625301,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612907,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616635,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751861,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 662551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 773396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 831699,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617606,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638131,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587407,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644712,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591923,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607758,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579332,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540788,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586804,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a492abab-07bf-5d8b-9618-f24142c5a470/a492abab-07bf-5d8b-9618-f24142c5a470_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549667,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/121be10b475a46dcbb2d1f22c40dbd68/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878725%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [ayvens.be] INFO: Saving data for 1878725: {'created_time': 1769631575.652595, 'last_price_update_time': 1769631575.652606, 'auction_closing_time': 1770107400.0}
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878725') HTTP/1.1" 204 0
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/6.jpg not downloaded yet
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/7.jpg not downloaded yet
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/8.jpg not downloaded yet
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/9.jpg not downloaded yet
2026-01-28 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/10.jpg not downloaded yet
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/11.jpg not downloaded yet
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30ce2d0>
2026-01-28 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/4.jpg saved to cache
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b5d010>
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/5.jpg saved to cache
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31aab90>
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/3.jpg saved to cache
2026-01-28 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a8ed0>
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/2.jpg saved to cache
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/12.jpg not downloaded yet
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b42790>
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/7.jpg saved to cache
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2e50>
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/13.jpg saved to cache
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/13.jpg not downloaded yet
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7e5d0>
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/6.jpg saved to cache
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d590>
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/8.jpg saved to cache
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/14.jpg not downloaded yet
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/15.jpg not downloaded yet
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/16.jpg not downloaded yet
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/17.jpg not downloaded yet
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:38 [ayvens.be] INFO: Found listing with ID: 1878728
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878728%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [ayvens.be] INFO: Scrape type for 1878728: 1
2026-01-28 20:19:38 [ayvens.be] INFO: Extracting data for car ID: 1878728
2026-01-28 20:19:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681792f2-b9bd-565a-be20-4dd7cca94f9f with identifier: 1878728
2026-01-28 20:19:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681792f2-b9bd-565a-be20-4dd7cca94f9f with scrape type 1
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/1.jpg not downloaded yet
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/2.jpg not downloaded yet
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/3.jpg not downloaded yet
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fada90>
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/16.jpg saved to cache
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/4.jpg not downloaded yet
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22710>
2026-01-28 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/15.jpg saved to cache
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/5.jpg not downloaded yet
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/6.jpg not downloaded yet
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f62950>
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/14.jpg saved to cache
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99a10>
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/10.jpg saved to cache
2026-01-28 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eebfd0>
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/11.jpg saved to cache
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c4b350>
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/3.jpg saved to cache
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d410>
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/2.jpg saved to cache
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9b090>
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/12.jpg saved to cache
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/7.jpg not downloaded yet
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/8.jpg not downloaded yet
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/9.jpg not downloaded yet
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/10.jpg not downloaded yet
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/11.jpg not downloaded yet
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/12.jpg not downloaded yet
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6dfd0>
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/12.jpg saved to cache
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/13.jpg not downloaded yet
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eba2d0>
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/6.jpg saved to cache
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0f850>
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/18.jpg saved to cache
2026-01-28 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e230d0>
2026-01-28 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/5.jpg saved to cache
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f51710>
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/4.jpg saved to cache
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/14.jpg not downloaded yet
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/15.jpg not downloaded yet
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ceab10>
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/7.jpg saved to cache
2026-01-28 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cbe6d0>
2026-01-28 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/1.jpg saved to cache
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cd610>
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/8.jpg saved to cache
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/16.jpg not downloaded yet
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/17.jpg not downloaded yet
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/18.jpg not downloaded yet
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/19.jpg not downloaded yet
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/20.jpg not downloaded yet
2026-01-28 20:19:43 [ayvens.be] INFO: Found listing with ID: 1878729
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878729%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [ayvens.be] INFO: Scrape type for 1878729: 1
2026-01-28 20:19:43 [ayvens.be] INFO: Extracting data for car ID: 1878729
2026-01-28 20:19:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with identifier: 1878729
2026-01-28 20:19:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with scrape type 1
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/1.jpg not downloaded yet
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/2.jpg not downloaded yet
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9510>
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/14.jpg saved to cache
2026-01-28 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad98ff0d0>
2026-01-28 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/16.jpg saved to cache
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98990>
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/15.jpg saved to cache
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cec990>
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/10.jpg saved to cache
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/3.jpg not downloaded yet
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2decd50>
2026-01-28 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/11.jpg saved to cache
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de9e90>
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/13.jpg saved to cache
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1e99690>
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/3.jpg saved to cache
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccb610>
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/4.jpg saved to cache
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/4.jpg not downloaded yet
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/5.jpg not downloaded yet
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/6.jpg not downloaded yet
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/7.jpg not downloaded yet
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/8.jpg not downloaded yet
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/9.jpg not downloaded yet
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/10.jpg not downloaded yet
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/11.jpg not downloaded yet
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2da90>
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/11.jpg saved to cache
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2def950>
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/7.jpg saved to cache
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dec110>
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/2.jpg saved to cache
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/12.jpg not downloaded yet
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eaaf50>
2026-01-28 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/8.jpg saved to cache
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e575d0>
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/6.jpg saved to cache
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f61510>
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/5.jpg saved to cache
2026-01-28 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d5a7d0>
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/13.jpg saved to cache
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1390>
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/12.jpg saved to cache
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/13.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/14.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/15.jpg not downloaded yet
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/16.jpg not downloaded yet
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/17.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/18.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/19.jpg not downloaded yet
2026-01-28 20:19:48 [ayvens.be] INFO: Found listing with ID: 1878730
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878730%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [ayvens.be] INFO: Scrape type for 1878730: 1
2026-01-28 20:19:48 [ayvens.be] INFO: Extracting data for car ID: 1878730
2026-01-28 20:19:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with identifier: 1878730
2026-01-28 20:19:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with scrape type 1
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/1.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/2.jpg not downloaded yet
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/3.jpg not downloaded yet
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3de50>
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/1.jpg saved to cache
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b76010>
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/16.jpg saved to cache
2026-01-28 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d510>
2026-01-28 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/17.jpg saved to cache
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db6f10>
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/17.jpg saved to cache
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f1d250>
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/15.jpg saved to cache
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/4.jpg not downloaded yet
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f492d0>
2026-01-28 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/9.jpg saved to cache
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dbc650>
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/10.jpg saved to cache
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03e10>
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/14.jpg saved to cache
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/5.jpg not downloaded yet
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/6.jpg not downloaded yet
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/7.jpg not downloaded yet
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/8.jpg not downloaded yet
2026-01-28 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/9.jpg not downloaded yet
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/10.jpg not downloaded yet
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/11.jpg not downloaded yet
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/12.jpg not downloaded yet
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/13.jpg not downloaded yet
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c49e50>
2026-01-28 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/5.jpg saved to cache
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/14.jpg not downloaded yet
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8d27050>
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/6.jpg saved to cache
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f29c50>
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/12.jpg saved to cache
2026-01-28 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dfa9d0>
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/1.jpg saved to cache
2026-01-28 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eabc50>
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/4.jpg saved to cache
2026-01-28 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0f290>
2026-01-28 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/3.jpg saved to cache
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edd150>
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/2.jpg saved to cache
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/15.jpg not downloaded yet
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff9090>
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/20.jpg saved to cache
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:19:53 [ayvens.be] INFO: Found listing with ID: 1878731
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878731%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [ayvens.be] INFO: Scrape type for 1878731: 1
2026-01-28 20:19:53 [ayvens.be] INFO: Extracting data for car ID: 1878731
2026-01-28 20:19:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e29154-4100-5806-bffc-0113dacd6513 with identifier: 1878731
2026-01-28 20:19:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e29154-4100-5806-bffc-0113dacd6513 with scrape type 1
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/1.jpg not downloaded yet
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/2.jpg not downloaded yet
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/3.jpg not downloaded yet
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/4.jpg not downloaded yet
2026-01-28 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/5.jpg not downloaded yet
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/6.jpg not downloaded yet
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/7.jpg not downloaded yet
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/8.jpg not downloaded yet
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/9.jpg not downloaded yet
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2d790>
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/10.jpg saved to cache
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/10.jpg not downloaded yet
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c03b90>
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/15.jpg saved to cache
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b26a90>
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/14.jpg saved to cache
2026-01-28 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f31ad0>
2026-01-28 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/13.jpg saved to cache
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e46690>
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/11.jpg saved to cache
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e238d0>
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/8.jpg saved to cache
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/11.jpg not downloaded yet
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/12.jpg not downloaded yet
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1eab710>
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/7.jpg saved to cache
2026-01-28 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2eeae50>
2026-01-28 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/9.jpg saved to cache
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/13.jpg not downloaded yet
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/14.jpg not downloaded yet
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/15.jpg not downloaded yet
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/16.jpg not downloaded yet
2026-01-28 20:19:56 [ayvens.be] INFO: Found listing with ID: 1878732
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878732%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [ayvens.be] INFO: Scrape type for 1878732: 1
2026-01-28 20:19:56 [ayvens.be] INFO: Extracting data for car ID: 1878732
2026-01-28 20:19:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f5920c-e394-5a43-a25e-0dbe74f803f5 with identifier: 1878732
2026-01-28 20:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f5920c-e394-5a43-a25e-0dbe74f803f5 with scrape type 1
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/1.jpg not downloaded yet
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/2.jpg not downloaded yet
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44e90>
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/6.jpg saved to cache
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/3.jpg not downloaded yet
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc5e90>
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/5.jpg saved to cache
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f60dd0>
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/3.jpg saved to cache
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22d90>
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/7.jpg saved to cache
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d22c10>
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/4.jpg saved to cache
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/4.jpg not downloaded yet
2026-01-28 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f623d0>
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/1.jpg saved to cache
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e98150>
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/2.jpg saved to cache
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8ce10>
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/8.jpg saved to cache
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/5.jpg not downloaded yet
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/6.jpg not downloaded yet
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2e210>
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/2.jpg saved to cache
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/7.jpg not downloaded yet
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/8.jpg not downloaded yet
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2debcd0>
2026-01-28 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/15.jpg saved to cache
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98250>
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/3.jpg saved to cache
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edea90>
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/12.jpg saved to cache
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de48d0>
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/1.jpg saved to cache
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/9.jpg not downloaded yet
2026-01-28 20:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/10.jpg not downloaded yet
2026-01-28 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/11.jpg not downloaded yet
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d65390>
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/14.jpg saved to cache
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9a6d0>
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/13.jpg saved to cache
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/12.jpg not downloaded yet
2026-01-28 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/13.jpg not downloaded yet
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f2d850>
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/10.jpg saved to cache
2026-01-28 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e577d0>
2026-01-28 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/12.jpg saved to cache
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d2f450>
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/11.jpg saved to cache
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de4450>
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/9.jpg saved to cache
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/14.jpg not downloaded yet
2026-01-28 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/15.jpg not downloaded yet
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/16.jpg not downloaded yet
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f98450>
2026-01-28 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/14.jpg saved to cache
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1edf290>
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/8.jpg saved to cache
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4e6d0>
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/13.jpg saved to cache
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/17.jpg not downloaded yet
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F18.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/18.jpg not downloaded yet
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cc690>
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/11.jpg saved to cache
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/19.jpg not downloaded yet
2026-01-28 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/20.jpg not downloaded yet
2026-01-28 20:20:03 [ayvens.be] INFO: Found listing with ID: 1878733
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878733%27 HTTP/1.1" 200 None
2026-01-28 20:20:03 [ayvens.be] INFO: Scrape type for 1878733: 1
2026-01-28 20:20:03 [ayvens.be] INFO: Extracting data for car ID: 1878733
2026-01-28 20:20:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f43163de-4ad6-58ae-bc54-a212c6224080 with identifier: 1878733
2026-01-28 20:20:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43163de-4ad6-58ae-bc54-a212c6224080 with scrape type 1
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg not downloaded yet
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6e0d0>
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/2.jpg saved to cache
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cccf10>
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/3.jpg saved to cache
2026-01-28 20:20:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2c2d0>
2026-01-28 20:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/16.jpg saved to cache
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fcb990>
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/4.jpg saved to cache
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg not downloaded yet
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee2250>
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/1.jpg saved to cache
2026-01-28 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8c490>
2026-01-28 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/5.jpg saved to cache
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc2090>
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/15.jpg saved to cache
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e20bd0>
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/6.jpg saved to cache
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg not downloaded yet
2026-01-28 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg not downloaded yet
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b50110>
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/7.jpg saved to cache
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg not downloaded yet
2026-01-28 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg not downloaded yet
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d21510>
2026-01-28 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/6.jpg saved to cache
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg not downloaded yet
2026-01-28 20:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg not downloaded yet
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg not downloaded yet
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e07f50>
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/10.jpg saved to cache
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44150>
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/7.jpg saved to cache
2026-01-28 20:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0e750>
2026-01-28 20:20:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/8.jpg saved to cache
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d53590>
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/13.jpg saved to cache
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg not downloaded yet
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg not downloaded yet
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de9d10>
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/11.jpg saved to cache
2026-01-28 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8c50>
2026-01-28 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/16.jpg saved to cache
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e62750>
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/9.jpg saved to cache
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg not downloaded yet
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [scrapy.extensions.logstats] INFO: Crawled 7 pages (at 3 pages/min), scraped 80 items (at 1 items/min)
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg not downloaded yet
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg not downloaded yet
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg not downloaded yet
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg not downloaded yet
2026-01-28 20:20:08 [ayvens.be] INFO: Found listing with ID: 1875508
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875508%27 HTTP/1.1" 200 None
2026-01-28 20:20:08 [ayvens.be] INFO: Scrape type for 1875508: 2
2026-01-28 20:20:08 [ayvens.be] INFO: Extracting data for car ID: 1875508
2026-01-28 20:20:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b3a5f13-459c-5997-bd0f-93516ac81e1e with identifier: 1875508
2026-01-28 20:20:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b3a5f13-459c-5997-bd0f-93516ac81e1e with scrape type 2
2026-01-28 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b3a5f13-459c-5997-bd0f-93516ac81e1e with scrape type 2
2026-01-28 20:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8b3a5f13-459c-5997-bd0f-93516ac81e1e, identifier: 1875508
2026-01-28 20:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8b3a5f13-459c-5997-bd0f-93516ac81e1e with identifier: 1875508
2026-01-28 20:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8b3a5f13-459c-5997-bd0f-93516ac81e1e with identifier: 1875508
2026-01-28 20:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8b3a5f13-459c-5997-bd0f-93516ac81e1e with identifier: 1875508 to the API
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '8b3a5f13-459c-5997-bd0f-93516ac81e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 121447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 2.0 D3 GEARTRONIC MOMENTUM PRO',
 'transmission': 'automatic',
 'trim': '2.0 D3 GEARTRONIC MOMENTUM PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875508%27 HTTP/1.1" 200 None
2026-01-28 20:20:09 [ayvens.be] INFO: Saving data for 1875508: {'auction_closing_time': 1770021000.0, 'created_time': 1769544038.749554, 'last_price_update_time': 1769631609.53193}
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875508') HTTP/1.1" 204 0
2026-01-28 20:20:09 [ayvens.be] INFO: Found listing with ID: 1875509
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875509%27 HTTP/1.1" 200 None
2026-01-28 20:20:09 [ayvens.be] INFO: Scrape type for 1875509: 2
2026-01-28 20:20:09 [ayvens.be] INFO: Extracting data for car ID: 1875509
2026-01-28 20:20:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with identifier: 1875509
2026-01-28 20:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with scrape type 2
2026-01-28 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with scrape type 2
2026-01-28 20:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c, identifier: 1875509
2026-01-28 20:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with identifier: 1875509
2026-01-28 20:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with identifier: 1875509
2026-01-28 20:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0d4b4952-7ba0-523c-a4ab-3301f6b09b1c with identifier: 1875509 to the API
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0d4b4952-7ba0-523c-a4ab-3301f6b09b1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 79304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 CORPORATE EDITION',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875509%27 HTTP/1.1" 200 None
2026-01-28 20:20:09 [ayvens.be] INFO: Saving data for 1875509: {'auction_closing_time': 1770021000.0, 'created_time': 1769544071.804821, 'last_price_update_time': 1769631609.939177}
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875509') HTTP/1.1" 204 0
2026-01-28 20:20:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ead0>
2026-01-28 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/15.jpg saved to cache
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcf8d0>
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/14.jpg saved to cache
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c52dd0>
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/5.jpg saved to cache
2026-01-28 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ff10>
2026-01-28 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/12.jpg saved to cache
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dcdf10>
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/18.jpg saved to cache
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d3ef50>
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/17.jpg saved to cache
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dce690>
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/19.jpg saved to cache
2026-01-28 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c50690>
2026-01-28 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F564bd0ae00ad433c80c0cd0e99be8643%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/20.jpg saved to cache
2026-01-28 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 04f5920c-e394-5a43-a25e-0dbe74f803f5
2026-01-28 20:20:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04f5920c-e394-5a43-a25e-0dbe74f803f5, skipping ID generation
2026-01-28 20:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f5920c-e394-5a43-a25e-0dbe74f803f5 with scrape type 1
2026-01-28 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 04f5920c-e394-5a43-a25e-0dbe74f803f5 from tracking dictionaries
2026-01-28 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04f5920c-e394-5a43-a25e-0dbe74f803f5 sending to next pipeline
2026-01-28 20:20:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 04f5920c-e394-5a43-a25e-0dbe74f803f5, identifier: 1878732
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [ayvens.be] INFO: Found listing with ID: 1875510
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875510%27 HTTP/1.1" 200 None
2026-01-28 20:20:12 [ayvens.be] INFO: Scrape type for 1875510: 2
2026-01-28 20:20:12 [ayvens.be] INFO: Extracting data for car ID: 1875510
2026-01-28 20:20:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc67da2-6c2b-544c-8c40-470b19892e9e with identifier: 1875510
2026-01-28 20:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc67da2-6c2b-544c-8c40-470b19892e9e with scrape type 2
2026-01-28 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fc67da2-6c2b-544c-8c40-470b19892e9e with scrape type 2
2026-01-28 20:20:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5fc67da2-6c2b-544c-8c40-470b19892e9e, identifier: 1875510
2026-01-28 20:20:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 04f5920c-e394-5a43-a25e-0dbe74f803f5 with identifier: 1878732
2026-01-28 20:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 04f5920c-e394-5a43-a25e-0dbe74f803f5 with identifier: 1878732
2026-01-28 20:20:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 04f5920c-e394-5a43-a25e-0dbe74f803f5 with identifier: 1878732 to the API
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '04f5920c-e394-5a43-a25e-0dbe74f803f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS CROSS',
 'odometer': 27007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612730,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 622986,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665268,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692872,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687513,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 901518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721409,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684684,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592920,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642687,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574501,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688059,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f5920c-e394-5a43-a25e-0dbe74f803f5/04f5920c-e394-5a43-a25e-0dbe74f803f5_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/564bd0ae00ad433c80c0cd0e99be8643/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS CROSS 1.5 VVT-IE HEV ADVENTURE CVT 4WD',
 'transmission': 'automatic',
 'trim': '1.5 VVT-IE HEV ADVENTURE CVT 4WD',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878732%27 HTTP/1.1" 200 None
2026-01-28 20:20:12 [ayvens.be] INFO: Saving data for 1878732: {'created_time': 1769631612.826669, 'last_price_update_time': 1769631612.826683, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878732') HTTP/1.1" 204 0
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5fc67da2-6c2b-544c-8c40-470b19892e9e with identifier: 1875510
2026-01-28 20:20:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5fc67da2-6c2b-544c-8c40-470b19892e9e with identifier: 1875510
2026-01-28 20:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
2026-01-28 20:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5fc67da2-6c2b-544c-8c40-470b19892e9e spider: ayvens.be
2026-01-28 20:20:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5fc67da2-6c2b-544c-8c40-470b19892e9e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv300' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'MAGMA ROOD GLANS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5fc67da2-6c2b-544c-8c40-470b19892e9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'NV300',
 'odometer': 28721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'NISSAN NV300 2.0 DCI 88KW ACENTA SWB 2.7T',
 'transmission': 'manual',
 'trim': '2.0 DCI 88KW ACENTA SWB 2.7T',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875510%27 HTTP/1.1" 200 None
2026-01-28 20:20:13 [ayvens.be] INFO: Saving data for 1875510: {'auction_closing_time': 1770021000.0, 'created_time': 1769544049.697978, 'last_price_update_time': 1769631613.074556}
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875510') HTTP/1.1" 204 0
2026-01-28 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:13 [ayvens.be] INFO: Found listing with ID: 1875511
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875511%27 HTTP/1.1" 200 None
2026-01-28 20:20:13 [ayvens.be] INFO: Scrape type for 1875511: 2
2026-01-28 20:20:13 [ayvens.be] INFO: Extracting data for car ID: 1875511
2026-01-28 20:20:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d66c59b-c5a6-5555-9c60-e83060a3e71f with identifier: 1875511
2026-01-28 20:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d66c59b-c5a6-5555-9c60-e83060a3e71f with scrape type 2
2026-01-28 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d66c59b-c5a6-5555-9c60-e83060a3e71f with scrape type 2
2026-01-28 20:20:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1d66c59b-c5a6-5555-9c60-e83060a3e71f, identifier: 1875511
2026-01-28 20:20:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1d66c59b-c5a6-5555-9c60-e83060a3e71f with identifier: 1875511
2026-01-28 20:20:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1d66c59b-c5a6-5555-9c60-e83060a3e71f with identifier: 1875511
2026-01-28 20:20:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1d66c59b-c5a6-5555-9c60-e83060a3e71f with identifier: 1875511 to the API
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1d66c59b-c5a6-5555-9c60-e83060a3e71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 94790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI 40 S TRONIC BUSINESS ED SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 40 S TRONIC BUSINESS ED SPORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875511%27 HTTP/1.1" 200 None
2026-01-28 20:20:13 [ayvens.be] INFO: Saving data for 1875511: {'auction_closing_time': 1770021000.0, 'created_time': 1769544063.287412, 'last_price_update_time': 1769631613.508455}
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875511') HTTP/1.1" 204 0
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dea510>
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg saved to cache
2026-01-28 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:13 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8a5bcd0>
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg saved to cache
2026-01-28 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de8fd0>
2026-01-28 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg saved to cache
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2dc75d0>
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg saved to cache
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1ec9250>
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg saved to cache
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f0ee50>
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg saved to cache
2026-01-28 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f17fd0>
2026-01-28 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg saved to cache
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99550>
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cs%252F5edd713aa2f74f3b890ca29b3eafbeb8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/4.jpg saved to cache
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8e29154-4100-5806-bffc-0113dacd6513
2026-01-28 20:20:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8e29154-4100-5806-bffc-0113dacd6513, skipping ID generation
2026-01-28 20:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e29154-4100-5806-bffc-0113dacd6513 with scrape type 1
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8e29154-4100-5806-bffc-0113dacd6513 from tracking dictionaries
2026-01-28 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8e29154-4100-5806-bffc-0113dacd6513 sending to next pipeline
2026-01-28 20:20:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8e29154-4100-5806-bffc-0113dacd6513, identifier: 1878731
2026-01-28 20:20:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8e29154-4100-5806-bffc-0113dacd6513 with identifier: 1878731
2026-01-28 20:20:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8e29154-4100-5806-bffc-0113dacd6513 with identifier: 1878731
2026-01-28 20:20:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f8e29154-4100-5806-bffc-0113dacd6513 with identifier: 1878731 to the API
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f8e29154-4100-5806-bffc-0113dacd6513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'EQC',
 'odometer': 32232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269474,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283866,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394277,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318161,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 354962,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352433,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420201,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302190,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 323150,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8e29154-4100-5806-bffc-0113dacd6513/f8e29154-4100-5806-bffc-0113dacd6513_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277785,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cs/5edd713aa2f74f3b890ca29b3eafbeb8/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ EQC BEV 80KWH EQC 400 4M BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': 'BEV 80KWH EQC 400 4M BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878731%27 HTTP/1.1" 200 None
2026-01-28 20:20:16 [ayvens.be] INFO: Saving data for 1878731: {'created_time': 1769631616.039491, 'last_price_update_time': 1769631616.039504, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878731') HTTP/1.1" 204 0
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99d10>
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg saved to cache
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0610>
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg saved to cache
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c98850>
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg saved to cache
2026-01-28 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d209d0>
2026-01-28 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg saved to cache
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df5210>
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg saved to cache
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0d410>
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg saved to cache
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ccb2d0>
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg saved to cache
2026-01-28 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f05010>
2026-01-28 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg saved to cache
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7eb10>
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fb2476284ec6a4d67b32714147804005c%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg saved to cache
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f43163de-4ad6-58ae-bc54-a212c6224080
2026-01-28 20:20:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f43163de-4ad6-58ae-bc54-a212c6224080, skipping ID generation
2026-01-28 20:20:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f43163de-4ad6-58ae-bc54-a212c6224080 with scrape type 1
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f43163de-4ad6-58ae-bc54-a212c6224080 from tracking dictionaries
2026-01-28 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f43163de-4ad6-58ae-bc54-a212c6224080 sending to next pipeline
2026-01-28 20:20:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f43163de-4ad6-58ae-bc54-a212c6224080, identifier: 1878733
2026-01-28 20:20:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f43163de-4ad6-58ae-bc54-a212c6224080 with identifier: 1878733
2026-01-28 20:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f43163de-4ad6-58ae-bc54-a212c6224080 with identifier: 1878733
2026-01-28 20:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '2', 'trim': 'bev 82kwh lrdm plus 4wd', 'title': 'polestar 2 bev 82kwh lrdm plus 4wd', 'price': 0, 'odometer': 33243, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-09', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'f43163de-4ad6-58ae-bc54-a212c6224080', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 216121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 218360}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 231148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 227027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 218751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 214022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 216543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 328550}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 254220}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 181082}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 286546}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 508773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 302601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 294661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 269542}], 'current_year_diff': 3, 'age_in_months': 27, 'make_model': 'polestar 2', 'sanitized_make': 'polestar', 'odometer_in_km': 33243}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'electric',
     'id': 'f43163de-4ad6-58ae-bc54-a212c6224080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 2',
     'model': '2',
     'odometer': 33243,
     'odometer_in_km': 33243,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216121,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218360,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227027,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218751,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 214022,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216543,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 328550,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 314440,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254220,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 181082,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 286546,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 508773,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 302601,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 294661,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269542,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-10-09',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 2 bev 82kwh lrdm plus 4wd',
     'transmission': 'automatic',
     'trim': 'bev 82kwh lrdm plus 4wd',
     'vin': None,
     'year': 2023}
2026-01-28 20:20:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: f43163de-4ad6-58ae-bc54-a212c6224080 spider: ayvens.be
2026-01-28 20:20:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f43163de-4ad6-58ae-bc54-a212c6224080 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '2', 'trim': 'bev 82kwh lrdm plus 4wd', 'title': 'polestar 2 bev 82kwh lrdm plus 4wd', 'price': 0, 'odometer': 33243, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-09', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'f43163de-4ad6-58ae-bc54-a212c6224080', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 216121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 218360}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 231148}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 227027}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 218751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 214022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 216543}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 328550}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314440}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 254220}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 181082}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 286546}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 508773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 302601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 294661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 269542}], 'current_year_diff': 3, 'age_in_months': 27, 'make_model': 'polestar 2', 'sanitized_make': 'polestar', 'odometer_in_km': 33243}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 27,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'electric',
     'id': 'f43163de-4ad6-58ae-bc54-a212c6224080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 2',
     'model': '2',
     'odometer': 33243,
     'odometer_in_km': 33243,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216121,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218360,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 231148,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 227027,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 218751,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 214022,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216543,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 328550,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 314440,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 254220,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 181082,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 286546,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 508773,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 302601,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 294661,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 269542,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2023-10-09',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 2 bev 82kwh lrdm plus 4wd',
     'transmission': 'automatic',
     'trim': 'bev 82kwh lrdm plus 4wd',
     'vin': None,
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f43163de-4ad6-58ae-bc54-a212c6224080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 33243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216121,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218360,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218751,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214022,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216543,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328550,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314440,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254220,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181082,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286546,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 302601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 294661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f43163de-4ad6-58ae-bc54-a212c6224080/f43163de-4ad6-58ae-bc54-a212c6224080_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/b2476284ec6a4d67b32714147804005c/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 82KWH LRDM PLUS 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH LRDM PLUS 4WD',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878733%27 HTTP/1.1" 200 None
2026-01-28 20:20:18 [ayvens.be] INFO: Saving data for 1878733: {'created_time': 1769631618.750734, 'last_price_update_time': 1769631618.750746, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878733') HTTP/1.1" 204 0
2026-01-28 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f3e110>
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/9.jpg saved to cache
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ffa690>
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252Ff5c0bda6d392473197e99cce0aa56f3e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/10.jpg saved to cache
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6
2026-01-28 20:20:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2befb1a3-31d2-5ba3-8707-0ff463379ae6, skipping ID generation
2026-01-28 20:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with scrape type 1
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2befb1a3-31d2-5ba3-8707-0ff463379ae6 from tracking dictionaries
2026-01-28 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2befb1a3-31d2-5ba3-8707-0ff463379ae6 sending to next pipeline
2026-01-28 20:20:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2befb1a3-31d2-5ba3-8707-0ff463379ae6, identifier: 1878730
2026-01-28 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with identifier: 1878730
2026-01-28 20:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with identifier: 1878730
2026-01-28 20:20:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2befb1a3-31d2-5ba3-8707-0ff463379ae6 with identifier: 1878730 to the API
2026-01-28 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2befb1a3-31d2-5ba3-8707-0ff463379ae6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 30247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612318,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712369,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573005,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 529054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433659,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522355,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624539,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396406,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682377,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2befb1a3-31d2-5ba3-8707-0ff463379ae6/2befb1a3-31d2-5ba3-8707-0ff463379ae6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414279,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/f5c0bda6d392473197e99cce0aa56f3e/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878730%27 HTTP/1.1" 200 None
2026-01-28 20:20:20 [ayvens.be] INFO: Saving data for 1878730: {'created_time': 1769631620.470358, 'last_price_update_time': 1769631620.470367, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878730') HTTP/1.1" 204 0
2026-01-28 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e34350>
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/19.jpg saved to cache
2026-01-28 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cf2e50>
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/19.jpg saved to cache
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de2810>
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/16.jpg saved to cache
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86d50>
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/17.jpg saved to cache
2026-01-28 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fc8410>
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ed%252Fe31577b876064361a80c5ff6dc0d050d%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/18.jpg saved to cache
2026-01-28 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1
2026-01-28 20:20:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1, skipping ID generation
2026-01-28 20:20:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with scrape type 1
2026-01-28 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 from tracking dictionaries
2026-01-28 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 sending to next pipeline
2026-01-28 20:20:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1, identifier: 1878729
2026-01-28 20:20:22 [ayvens.be] INFO: Found listing with ID: 1875512
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875512%27 HTTP/1.1" 200 None
2026-01-28 20:20:22 [ayvens.be] INFO: Scrape type for 1875512: 2
2026-01-28 20:20:22 [ayvens.be] INFO: Extracting data for car ID: 1875512
2026-01-28 20:20:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f4081c-f82d-5bf6-be4a-05f73b661b6c with identifier: 1875512
2026-01-28 20:20:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f4081c-f82d-5bf6-be4a-05f73b661b6c with scrape type 2
2026-01-28 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f4081c-f82d-5bf6-be4a-05f73b661b6c with scrape type 2
2026-01-28 20:20:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 21f4081c-f82d-5bf6-be4a-05f73b661b6c, identifier: 1875512
2026-01-28 20:20:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with identifier: 1878729
2026-01-28 20:20:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with identifier: 1878729
2026-01-28 20:20:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3a1ab4d7-2057-55a1-83ec-52418c7b0ea1 with identifier: 1878729 to the API
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '3a1ab4d7-2057-55a1-83ec-52418c7b0ea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 47343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 492040,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 472348,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 498643,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 466582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592461,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617930,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681552,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 437265,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 462145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527593,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 474172,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 666219,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1ab4d7-2057-55a1-83ec-52418c7b0ea1/3a1ab4d7-2057-55a1-83ec-52418c7b0ea1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ed/e31577b876064361a80c5ff6dc0d050d/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV AUTO RWD',
 'transmission': 'automatic',
 'trim': 'BEV AUTO RWD',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878729%27 HTTP/1.1" 200 None
2026-01-28 20:20:22 [ayvens.be] INFO: Saving data for 1878729: {'created_time': 1769631622.682091, 'last_price_update_time': 1769631622.682103, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878729') HTTP/1.1" 204 0
2026-01-28 20:20:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 21f4081c-f82d-5bf6-be4a-05f73b661b6c with identifier: 1875512
2026-01-28 20:20:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 21f4081c-f82d-5bf6-be4a-05f73b661b6c with identifier: 1875512
2026-01-28 20:20:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 21f4081c-f82d-5bf6-be4a-05f73b661b6c with identifier: 1875512 to the API
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '21f4081c-f82d-5bf6-be4a-05f73b661b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN ALLSPACE',
 'odometer': 94576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN ALLSPACE 2.0 TDI HIGHLINE DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI HIGHLINE DSG',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875512%27 HTTP/1.1" 200 None
2026-01-28 20:20:23 [ayvens.be] INFO: Saving data for 1875512: {'auction_closing_time': 1770021000.0, 'created_time': 1769544064.962993, 'last_price_update_time': 1769631623.077405}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875512') HTTP/1.1" 204 0
2026-01-28 20:20:23 [ayvens.be] INFO: Found listing with ID: 1875513
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875513%27 HTTP/1.1" 200 None
2026-01-28 20:20:23 [ayvens.be] INFO: Scrape type for 1875513: 2
2026-01-28 20:20:23 [ayvens.be] INFO: Extracting data for car ID: 1875513
2026-01-28 20:20:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with identifier: 1875513
2026-01-28 20:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with scrape type 2
2026-01-28 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with scrape type 2
2026-01-28 20:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628, identifier: 1875513
2026-01-28 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with identifier: 1875513
2026-01-28 20:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with identifier: 1875513
2026-01-28 20:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628 with identifier: 1875513 to the API
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7a2d8fa7-e7cd-5f65-8451-fa5db8fbb628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA DIESEL - 2020',
 'odometer': 62157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA DIESEL - 2020 1.5 TDCi EB FWD Titanium',
 'transmission': 'automatic',
 'trim': '1.5 TDCi EB FWD Titanium',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875513%27 HTTP/1.1" 200 None
2026-01-28 20:20:23 [ayvens.be] INFO: Saving data for 1875513: {'auction_closing_time': 1770021000.0, 'created_time': 1769544075.492444, 'last_price_update_time': 1769631623.494931}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875513') HTTP/1.1" 204 0
2026-01-28 20:20:23 [ayvens.be] INFO: Found listing with ID: 1875514
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875514%27 HTTP/1.1" 200 None
2026-01-28 20:20:23 [ayvens.be] INFO: Scrape type for 1875514: 2
2026-01-28 20:20:23 [ayvens.be] INFO: Extracting data for car ID: 1875514
2026-01-28 20:20:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with identifier: 1875514
2026-01-28 20:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with scrape type 2
2026-01-28 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with scrape type 2
2026-01-28 20:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a, identifier: 1875514
2026-01-28 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with identifier: 1875514
2026-01-28 20:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with identifier: 1875514
2026-01-28 20:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a with identifier: 1875514 to the API
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2beb801d-c0c9-53fb-8bf7-dc2b6c1f7c8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 83674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.5 TSI ACT Life OPF',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Life OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875514%27 HTTP/1.1" 200 None
2026-01-28 20:20:23 [ayvens.be] INFO: Saving data for 1875514: {'auction_closing_time': 1770021000.0, 'created_time': 1769544082.219842, 'last_price_update_time': 1769631623.892628}
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875514') HTTP/1.1" 204 0
2026-01-28 20:20:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30cd7d0>
2026-01-28 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252F8ca9186cd3c144c48069726aa634836a%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/18.jpg saved to cache
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 681792f2-b9bd-565a-be20-4dd7cca94f9f
2026-01-28 20:20:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 681792f2-b9bd-565a-be20-4dd7cca94f9f, skipping ID generation
2026-01-28 20:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681792f2-b9bd-565a-be20-4dd7cca94f9f with scrape type 1
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 681792f2-b9bd-565a-be20-4dd7cca94f9f from tracking dictionaries
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 681792f2-b9bd-565a-be20-4dd7cca94f9f sending to next pipeline
2026-01-28 20:20:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 681792f2-b9bd-565a-be20-4dd7cca94f9f, identifier: 1878728
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e451d0>
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ba%252Ff4aec34915db4722863f446c9773a0a5%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/9.jpg saved to cache
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dcd7520-a081-518f-9974-188db7d9efc0
2026-01-28 20:20:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dcd7520-a081-518f-9974-188db7d9efc0, skipping ID generation
2026-01-28 20:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dcd7520-a081-518f-9974-188db7d9efc0 with scrape type 1
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5dcd7520-a081-518f-9974-188db7d9efc0 from tracking dictionaries
2026-01-28 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dcd7520-a081-518f-9974-188db7d9efc0 sending to next pipeline
2026-01-28 20:20:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5dcd7520-a081-518f-9974-188db7d9efc0, identifier: 1878727
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d94f90>
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/17.jpg saved to cache
2026-01-28 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:25 [ayvens.be] INFO: Found listing with ID: 1875515
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875515%27 HTTP/1.1" 200 None
2026-01-28 20:20:25 [ayvens.be] INFO: Scrape type for 1875515: 2
2026-01-28 20:20:25 [ayvens.be] INFO: Extracting data for car ID: 1875515
2026-01-28 20:20:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with identifier: 1875515
2026-01-28 20:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with scrape type 2
2026-01-28 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with scrape type 2
2026-01-28 20:20:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c5d9326d-8f8b-5f1e-bf94-cdc780f552eb, identifier: 1875515
2026-01-28 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 681792f2-b9bd-565a-be20-4dd7cca94f9f with identifier: 1878728
2026-01-28 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 681792f2-b9bd-565a-be20-4dd7cca94f9f with identifier: 1878728
2026-01-28 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132418 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132418
2026-01-28 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 681792f2-b9bd-565a-be20-4dd7cca94f9f spider: ayvens.be
2026-01-28 20:20:25 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 681792f2-b9bd-565a-be20-4dd7cca94f9f due to rule: high_mileage_for_country.json, error: 132418 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132418
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '681792f2-b9bd-565a-be20-4dd7cca94f9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 132418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 640259,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616695,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644692,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636519,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629417,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692852,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 682033,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 800878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 768507,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638378,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482128,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594006,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 456137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681792f2-b9bd-565a-be20-4dd7cca94f9f/681792f2-b9bd-565a-be20-4dd7cca94f9f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/8ca9186cd3c144c48069726aa634836a/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S BUSINESS GPS '
          'AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S BUSINESS GPS AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878728%27 HTTP/1.1" 200 None
2026-01-28 20:20:25 [ayvens.be] INFO: Saving data for 1878728: {'created_time': 1769631625.368004, 'last_price_update_time': 1769631625.368013, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878728') HTTP/1.1" 204 0
2026-01-28 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5dcd7520-a081-518f-9974-188db7d9efc0 with identifier: 1878727
2026-01-28 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5dcd7520-a081-518f-9974-188db7d9efc0 with identifier: 1878727
2026-01-28 20:20:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5dcd7520-a081-518f-9974-188db7d9efc0 with identifier: 1878727 to the API
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '5dcd7520-a081-518f-9974-188db7d9efc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 90478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691828,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671410,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681187,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700742,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661698,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 508740,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613049,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 638213,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 587361,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 452060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dcd7520-a081-518f-9974-188db7d9efc0/5dcd7520-a081-518f-9974-188db7d9efc0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ba/f4aec34915db4722863f446c9773a0a5/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.5 35 TFSI',
 'transmission': 'manual',
 'trim': '1.5 35 TFSI',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878727%27 HTTP/1.1" 200 None
2026-01-28 20:20:25 [ayvens.be] INFO: Saving data for 1878727: {'created_time': 1769631625.741055, 'last_price_update_time': 1769631625.741065, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878727') HTTP/1.1" 204 0
2026-01-28 20:20:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with identifier: 1875515
2026-01-28 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with identifier: 1875515
2026-01-28 20:20:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c5d9326d-8f8b-5f1e-bf94-cdc780f552eb with identifier: 1875515 to the API
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'GRIS PLATINIUM M',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c5d9326d-8f8b-5f1e-bf94-cdc780f552eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 91309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 AUTO GT PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 AUTO GT PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875515%27 HTTP/1.1" 200 None
2026-01-28 20:20:26 [ayvens.be] INFO: Saving data for 1875515: {'auction_closing_time': 1770021000.0, 'created_time': 1769544090.905089, 'last_price_update_time': 1769631626.067862}
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875515') HTTP/1.1" 204 0
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e44450>
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/1.jpg saved to cache
2026-01-28 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d7c850>
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/2.jpg saved to cache
2026-01-28 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:20:26 [ayvens.be] INFO: Found listing with ID: 1875516
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875516%27 HTTP/1.1" 200 None
2026-01-28 20:20:26 [ayvens.be] INFO: Scrape type for 1875516: 2
2026-01-28 20:20:26 [ayvens.be] INFO: Extracting data for car ID: 1875516
2026-01-28 20:20:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc26db21-0b3c-5609-9e07-03f3e1b77b73 with identifier: 1875516
2026-01-28 20:20:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc26db21-0b3c-5609-9e07-03f3e1b77b73 with scrape type 2
2026-01-28 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc26db21-0b3c-5609-9e07-03f3e1b77b73 with scrape type 2
2026-01-28 20:20:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fc26db21-0b3c-5609-9e07-03f3e1b77b73, identifier: 1875516
2026-01-28 20:20:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fc26db21-0b3c-5609-9e07-03f3e1b77b73 with identifier: 1875516
2026-01-28 20:20:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:20:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fc26db21-0b3c-5609-9e07-03f3e1b77b73 with identifier: 1875516
2026-01-28 20:20:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 125765 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125765
2026-01-28 20:20:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fc26db21-0b3c-5609-9e07-03f3e1b77b73 spider: ayvens.be
2026-01-28 20:20:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: fc26db21-0b3c-5609-9e07-03f3e1b77b73 due to rule: high_mileage_for_country.json, error: 125765 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125765
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'color': 'ARKTIKGRAU BRILLANTEFFEKT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fc26db21-0b3c-5609-9e07-03f3e1b77b73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 125765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0 XDRIVE45E 4WD AUTO',
 'transmission': 'automatic',
 'trim': '3.0 XDRIVE45E 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875516%27 HTTP/1.1" 200 None
2026-01-28 20:20:26 [ayvens.be] INFO: Saving data for 1875516: {'auction_closing_time': 1770021000.0, 'created_time': 1769544097.618946, 'last_price_update_time': 1769631626.990713}
2026-01-28 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875516') HTTP/1.1" 204 0
2026-01-28 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:27 [ayvens.be] INFO: Found listing with ID: 1875517
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875517%27 HTTP/1.1" 200 None
2026-01-28 20:20:27 [ayvens.be] INFO: Scrape type for 1875517: 2
2026-01-28 20:20:27 [ayvens.be] INFO: Extracting data for car ID: 1875517
2026-01-28 20:20:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f with identifier: 1875517
2026-01-28 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f with scrape type 2
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f with scrape type 2
2026-01-28 20:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f, identifier: 1875517
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2e8d0>
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1ys%252Fbbf0563467b14864ad240efbdf3fddd4%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/20.jpg saved to cache
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7
2026-01-28 20:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7, skipping ID generation
2026-01-28 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with scrape type 1
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 from tracking dictionaries
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 sending to next pipeline
2026-01-28 20:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7, identifier: 1878723
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40cd0>
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2aq%252Fd7c97f03415c4149a00e9e32bb82da6e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/1.jpg saved to cache
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c
2026-01-28 20:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c, skipping ID generation
2026-01-28 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with scrape type 1
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c from tracking dictionaries
2026-01-28 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c sending to next pipeline
2026-01-28 20:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c, identifier: 1878724
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e99a10>
2026-01-28 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cp%252F51b2be74ce7d4168a818b346d33dcf99%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/9.jpg saved to cache
2026-01-28 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7570669-31a1-5050-90a5-cf2166c8c7f1
2026-01-28 20:20:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7570669-31a1-5050-90a5-cf2166c8c7f1, skipping ID generation
2026-01-28 20:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7570669-31a1-5050-90a5-cf2166c8c7f1 with scrape type 1
2026-01-28 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f7570669-31a1-5050-90a5-cf2166c8c7f1 from tracking dictionaries
2026-01-28 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7570669-31a1-5050-90a5-cf2166c8c7f1 sending to next pipeline
2026-01-28 20:20:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f7570669-31a1-5050-90a5-cf2166c8c7f1, identifier: 1878726
2026-01-28 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f with identifier: 1875517
2026-01-28 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f with identifier: 1875517
2026-01-28 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 125164 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125164
2026-01-28 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f spider: ayvens.be
2026-01-28 20:20:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f due to rule: high_mileage_for_country.json, error: 125164 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125164
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '3349c8fb-91eb-5e9b-8bba-6c8ef49b8d5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'E-TRON',
 'odometer': 125164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI E-TRON BEV 95KWH 55 QUATTRO ADVANCED',
 'transmission': 'automatic',
 'trim': 'BEV 95KWH 55 QUATTRO ADVANCED',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875517%27 HTTP/1.1" 200 None
2026-01-28 20:20:28 [ayvens.be] INFO: Saving data for 1875517: {'auction_closing_time': 1770021000.0, 'created_time': 1769544106.451554, 'last_price_update_time': 1769631628.457456}
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875517') HTTP/1.1" 204 0
2026-01-28 20:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with identifier: 1878723
2026-01-28 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with identifier: 1878723
2026-01-28 20:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 907d6542-907b-5a6d-a7c0-bf6b6cac37a7 with identifier: 1878723 to the API
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '907d6542-907b-5a6d-a7c0-bf6b6cac37a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552464,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722225,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 739256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 806955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664996,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653686,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778404,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568485,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645783,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560883,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593148,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 538769,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613536,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907d6542-907b-5a6d-a7c0-bf6b6cac37a7/907d6542-907b-5a6d-a7c0-bf6b6cac37a7_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 441057,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1ys/bbf0563467b14864ad240efbdf3fddd4/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878723%27 HTTP/1.1" 200 None
2026-01-28 20:20:28 [ayvens.be] INFO: Saving data for 1878723: {'created_time': 1769631628.835182, 'last_price_update_time': 1769631628.835193, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878723') HTTP/1.1" 204 0
2026-01-28 20:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with identifier: 1878724
2026-01-28 20:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with identifier: 1878724
2026-01-28 20:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 40c854d5-2aaf-5bd9-946c-d4fcfd84d61c with identifier: 1878724 to the API
2026-01-28 20:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '40c854d5-2aaf-5bd9-946c-d4fcfd84d61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 112464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605334,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611838,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 743878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641750,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665709,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 745720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637795,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558183,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611899,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542435,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c854d5-2aaf-5bd9-946c-d4fcfd84d61c/40c854d5-2aaf-5bd9-946c-d4fcfd84d61c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2aq/d7c97f03415c4149a00e9e32bb82da6e/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TDI 40 S TRONIC BUSINESS ED SPORT',
 'transmission': 'automatic',
 'trim': '2.0 TDI 40 S TRONIC BUSINESS ED SPORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878724%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Saving data for 1878724: {'created_time': 1769631629.214542, 'last_price_update_time': 1769631629.214551, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878724') HTTP/1.1" 204 0
2026-01-28 20:20:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f7570669-31a1-5050-90a5-cf2166c8c7f1 with identifier: 1878726
2026-01-28 20:20:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f7570669-31a1-5050-90a5-cf2166c8c7f1 with identifier: 1878726
2026-01-28 20:20:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f7570669-31a1-5050-90a5-cf2166c8c7f1 with identifier: 1878726 to the API
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f7570669-31a1-5050-90a5-cf2166c8c7f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 3 CROSSBACK',
 'odometer': 47802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575728,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517021,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 521127,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571847,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633652,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 893813,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 788429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562192,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569862,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636720,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546718,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7570669-31a1-5050-90a5-cf2166c8c7f1/f7570669-31a1-5050-90a5-cf2166c8c7f1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523281,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cp/51b2be74ce7d4168a818b346d33dcf99/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 3 CROSSBACK 1.2 PURETECH 130 BASTILLE AUTO',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 BASTILLE AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878726%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Saving data for 1878726: {'created_time': 1769631629.60242, 'last_price_update_time': 1769631629.60243, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878726') HTTP/1.1" 204 0
2026-01-28 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:29 [ayvens.be] INFO: Found listing with ID: 1875518
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875518%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Scrape type for 1875518: 0
2026-01-28 20:20:29 [ayvens.be] INFO: Found listing with ID: 1875519
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875519%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Scrape type for 1875519: 0
2026-01-28 20:20:29 [ayvens.be] INFO: Found listing with ID: 1875520
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875520%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Scrape type for 1875520: 0
2026-01-28 20:20:29 [ayvens.be] INFO: Found listing with ID: 1875521
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875521%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Scrape type for 1875521: 0
2026-01-28 20:20:29 [ayvens.be] INFO: Found listing with ID: 1875522
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875522%27 HTTP/1.1" 200 None
2026-01-28 20:20:29 [ayvens.be] INFO: Scrape type for 1875522: 2
2026-01-28 20:20:29 [ayvens.be] INFO: Extracting data for car ID: 1875522
2026-01-28 20:20:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc407d7-9aef-5a5d-810c-e95174a2a90d with identifier: 1875522
2026-01-28 20:20:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc407d7-9aef-5a5d-810c-e95174a2a90d with scrape type 2
2026-01-28 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc407d7-9aef-5a5d-810c-e95174a2a90d with scrape type 2
2026-01-28 20:20:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7fc407d7-9aef-5a5d-810c-e95174a2a90d, identifier: 1875522
2026-01-28 20:20:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7fc407d7-9aef-5a5d-810c-e95174a2a90d with identifier: 1875522
2026-01-28 20:20:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7fc407d7-9aef-5a5d-810c-e95174a2a90d with identifier: 1875522
2026-01-28 20:20:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7fc407d7-9aef-5a5d-810c-e95174a2a90d with identifier: 1875522 to the API
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7fc407d7-9aef-5a5d-810c-e95174a2a90d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 105061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D GEARTRONIC R-DESIGN',
 'transmission': 'automatic',
 'trim': '2.0 B4 D GEARTRONIC R-DESIGN',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875522%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Saving data for 1875522: {'auction_closing_time': 1770021000.0, 'created_time': 1769544140.250182, 'last_price_update_time': 1769631630.131836}
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875522') HTTP/1.1" 204 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875523
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875523%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875523: 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875524
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875524%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875524: 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875525
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875525%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875525: 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875526
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875526%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875526: 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875527
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875527%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875527: 0
2026-01-28 20:20:30 [ayvens.be] INFO: Found listing with ID: 1875528
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875528%27 HTTP/1.1" 200 None
2026-01-28 20:20:30 [ayvens.be] INFO: Scrape type for 1875528: 2
2026-01-28 20:20:30 [ayvens.be] INFO: Extracting data for car ID: 1875528
2026-01-28 20:20:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d0e26e-5592-57a6-8dcd-065a58650d3e with identifier: 1875528
2026-01-28 20:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d0e26e-5592-57a6-8dcd-065a58650d3e with scrape type 2
2026-01-28 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d0e26e-5592-57a6-8dcd-065a58650d3e with scrape type 2
2026-01-28 20:20:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63d0e26e-5592-57a6-8dcd-065a58650d3e, identifier: 1875528
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de5410>
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/13.jpg saved to cache
2026-01-28 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de67d0>
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/12.jpg saved to cache
2026-01-28 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63d0e26e-5592-57a6-8dcd-065a58650d3e with identifier: 1875528
2026-01-28 20:20:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63d0e26e-5592-57a6-8dcd-065a58650d3e with identifier: 1875528
2026-01-28 20:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148610 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148610
2026-01-28 20:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 63d0e26e-5592-57a6-8dcd-065a58650d3e spider: ayvens.be
2026-01-28 20:20:31 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 63d0e26e-5592-57a6-8dcd-065a58650d3e due to rule: high_mileage_for_country.json, error: 148610 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148610
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '63d0e26e-5592-57a6-8dcd-065a58650d3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS CLA SHOOTING BREAK (X118',
 'odometer': 148610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS CLA SHOOTING BREAK (X118 CLA 180',
 'transmission': 'automatic',
 'trim': 'CLA 180',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875528%27 HTTP/1.1" 200 None
2026-01-28 20:20:31 [ayvens.be] INFO: Saving data for 1875528: {'auction_closing_time': 1770021000.0, 'created_time': 1769544179.86326, 'last_price_update_time': 1769631631.408605}
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875528') HTTP/1.1" 204 0
2026-01-28 20:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:31 [ayvens.be] INFO: Found listing with ID: 1875529
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875529%27 HTTP/1.1" 200 None
2026-01-28 20:20:31 [ayvens.be] INFO: Scrape type for 1875529: 0
2026-01-28 20:20:31 [ayvens.be] INFO: Found listing with ID: 1875530
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875530%27 HTTP/1.1" 200 None
2026-01-28 20:20:31 [ayvens.be] INFO: Scrape type for 1875530: 0
2026-01-28 20:20:31 [ayvens.be] INFO: Found listing with ID: 1875531
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875531%27 HTTP/1.1" 200 None
2026-01-28 20:20:31 [ayvens.be] INFO: Scrape type for 1875531: 0
2026-01-28 20:20:31 [ayvens.be] INFO: Found listing with ID: 1875532
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875532%27 HTTP/1.1" 200 None
2026-01-28 20:20:31 [ayvens.be] INFO: Scrape type for 1875532: 2
2026-01-28 20:20:31 [ayvens.be] INFO: Extracting data for car ID: 1875532
2026-01-28 20:20:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec836fcd-3fc0-5847-86d2-fc0dd9e889da with identifier: 1875532
2026-01-28 20:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec836fcd-3fc0-5847-86d2-fc0dd9e889da with scrape type 2
2026-01-28 20:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec836fcd-3fc0-5847-86d2-fc0dd9e889da with scrape type 2
2026-01-28 20:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ec836fcd-3fc0-5847-86d2-fc0dd9e889da, identifier: 1875532
2026-01-28 20:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ec836fcd-3fc0-5847-86d2-fc0dd9e889da with identifier: 1875532
2026-01-28 20:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ec836fcd-3fc0-5847-86d2-fc0dd9e889da with identifier: 1875532
2026-01-28 20:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ec836fcd-3fc0-5847-86d2-fc0dd9e889da with identifier: 1875532 to the API
2026-01-28 20:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ec836fcd-3fc0-5847-86d2-fc0dd9e889da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 35224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875532%27 HTTP/1.1" 200 None
2026-01-28 20:20:32 [ayvens.be] INFO: Saving data for 1875532: {'auction_closing_time': 1770021000.0, 'created_time': 1769544204.180709, 'last_price_update_time': 1769631632.956198}
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875532') HTTP/1.1" 204 0
2026-01-28 20:20:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e9a490>
2026-01-28 20:20:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2fa%252Fbeb56b70ffab4377991dbcf2e0409548%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/11.jpg saved to cache
2026-01-28 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54
2026-01-28 20:20:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 with identifier: 1878722
2026-01-28 20:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 with identifier: 1878722
2026-01-28 20:20:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 with identifier: 1878722 to the API
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:33 [scrapy.core.scraper] DEBUG: Scraped from [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '110a08a9-2e2c-5f6c-bf76-ddab79b9fd54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 41255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/1.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/2.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/3.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/4.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/5.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/6.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/7.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/8.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/9.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/10.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/11.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/12.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/13.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/14.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/15.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/16.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/17.jpg',
                'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/18.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542106,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531399,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 702430,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710714,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 987365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 998668,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683944,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620067,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614289,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574424,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527251,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564869,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_110a08a9-2e2c-5f6c-bf76-ddab79b9fd54/110a08a9-2e2c-5f6c-bf76-ddab79b9fd54_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 565582,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2fa/beb56b70ffab4377991dbcf2e0409548/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 55KWH 35 ATTRACTION AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 55KWH 35 ATTRACTION AUTO',
 'vin': None,
 'year': 2024}
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878722%27 HTTP/1.1" 200 None
2026-01-28 20:20:33 [ayvens.be] INFO: Saving data for 1878722: {'created_time': 1769631633.635066, 'last_price_update_time': 1769631633.635077, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878722') HTTP/1.1" 204 0
2026-01-28 20:20:33 [ayvens.be] INFO: Found listing with ID: 1875533
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875533%27 HTTP/1.1" 200 None
2026-01-28 20:20:33 [ayvens.be] INFO: Scrape type for 1875533: 2
2026-01-28 20:20:33 [ayvens.be] INFO: Extracting data for car ID: 1875533
2026-01-28 20:20:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f with identifier: 1875533
2026-01-28 20:20:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f with scrape type 2
2026-01-28 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f with scrape type 2
2026-01-28 20:20:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f, identifier: 1875533
2026-01-28 20:20:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 110a08a9-2e2c-5f6c-bf76-ddab79b9fd54 due to [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-01-28 20:20:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f with identifier: 1875533
2026-01-28 20:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f with identifier: 1875533
2026-01-28 20:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150324 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    150324
2026-01-28 20:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f spider: ayvens.be
2026-01-28 20:20:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f due to rule: high_mileage_for_country.json, error: 150324 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    150324
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '0e2481ed-4c9b-5b6a-93e0-cb35199d6e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 150324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI ACT Ambition (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition (EU6.2)',
 'vin': None,
 'year': 2018}
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875533%27 HTTP/1.1" 200 None
2026-01-28 20:20:33 [ayvens.be] INFO: Saving data for 1875533: {'auction_closing_time': 1770021000.0, 'created_time': 1769544220.044761, 'last_price_update_time': 1769631633.987816}
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875533') HTTP/1.1" 204 0
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f4b450>
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/7.jpg saved to cache
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee3550>
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cq%252F75a5097eff134a9c99599ba95aa731cb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/6.jpg saved to cache
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4eef175f-9c45-536e-8892-b070e810e995
2026-01-28 20:20:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4eef175f-9c45-536e-8892-b070e810e995, skipping ID generation
2026-01-28 20:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eef175f-9c45-536e-8892-b070e810e995 with scrape type 1
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4eef175f-9c45-536e-8892-b070e810e995 from tracking dictionaries
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4eef175f-9c45-536e-8892-b070e810e995 sending to next pipeline
2026-01-28 20:20:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4eef175f-9c45-536e-8892-b070e810e995, identifier: 1878721
2026-01-28 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:34 [ayvens.be] INFO: Found listing with ID: 1875534
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875534%27 HTTP/1.1" 200 None
2026-01-28 20:20:34 [ayvens.be] INFO: Scrape type for 1875534: 2
2026-01-28 20:20:34 [ayvens.be] INFO: Extracting data for car ID: 1875534
2026-01-28 20:20:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 248641f2-a026-59a2-97b4-3a6ab1e72656 with identifier: 1875534
2026-01-28 20:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 248641f2-a026-59a2-97b4-3a6ab1e72656 with scrape type 2
2026-01-28 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 248641f2-a026-59a2-97b4-3a6ab1e72656 with scrape type 2
2026-01-28 20:20:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 248641f2-a026-59a2-97b4-3a6ab1e72656, identifier: 1875534
2026-01-28 20:20:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4eef175f-9c45-536e-8892-b070e810e995 with identifier: 1878721
2026-01-28 20:20:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4eef175f-9c45-536e-8892-b070e810e995 with identifier: 1878721
2026-01-28 20:20:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4eef175f-9c45-536e-8892-b070e810e995 with identifier: 1878721 to the API
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4eef175f-9c45-536e-8892-b070e810e995',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 42491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590611,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676607,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 563683,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551499,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635925,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 697233,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658426,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512306,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609114,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649571,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573603,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eef175f-9c45-536e-8892-b070e810e995/4eef175f-9c45-536e-8892-b070e810e995_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646518,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cq/75a5097eff134a9c99599ba95aa731cb/images/large/14.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878721%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Saving data for 1878721: {'created_time': 1769631635.104888, 'last_price_update_time': 1769631635.1049, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878721') HTTP/1.1" 204 0
2026-01-28 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 248641f2-a026-59a2-97b4-3a6ab1e72656 with identifier: 1875534
2026-01-28 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 248641f2-a026-59a2-97b4-3a6ab1e72656 with identifier: 1875534
2026-01-28 20:20:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 248641f2-a026-59a2-97b4-3a6ab1e72656 with identifier: 1875534 to the API
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'METAALKLEUR MINERALGRAU',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '248641f2-a026-59a2-97b4-3a6ab1e72656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1-serie',
 'odometer': 121221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1-serie 1.5 116IA (80KW)',
 'transmission': 'automatic',
 'trim': '1.5 116IA (80KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875534%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Saving data for 1875534: {'auction_closing_time': 1770021000.0, 'created_time': 1769544220.470264, 'last_price_update_time': 1769631635.396839}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875534') HTTP/1.1" 204 0
2026-01-28 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875535
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875535%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875535: 2
2026-01-28 20:20:35 [ayvens.be] INFO: Extracting data for car ID: 1875535
2026-01-28 20:20:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1301e4a0-9535-5222-81ec-c34cd0caad73 with identifier: 1875535
2026-01-28 20:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1301e4a0-9535-5222-81ec-c34cd0caad73 with scrape type 2
2026-01-28 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1301e4a0-9535-5222-81ec-c34cd0caad73 with scrape type 2
2026-01-28 20:20:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1301e4a0-9535-5222-81ec-c34cd0caad73, identifier: 1875535
2026-01-28 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1301e4a0-9535-5222-81ec-c34cd0caad73 with identifier: 1875535
2026-01-28 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1301e4a0-9535-5222-81ec-c34cd0caad73 with identifier: 1875535
2026-01-28 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177864 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177864
2026-01-28 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1301e4a0-9535-5222-81ec-c34cd0caad73 spider: ayvens.be
2026-01-28 20:20:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 1301e4a0-9535-5222-81ec-c34cd0caad73 due to rule: high_mileage_for_country.json, error: 177864 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177864
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'COSMOSZWART',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1301e4a0-9535-5222-81ec-c34cd0caad73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLA (H247)',
 'odometer': 177864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLA (H247) GLA 200 Business Solution',
 'transmission': 'automatic',
 'trim': 'GLA 200 Business Solution',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875535%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Saving data for 1875535: {'auction_closing_time': 1770021000.0, 'created_time': 1769544226.817456, 'last_price_update_time': 1769631635.744916}
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875535') HTTP/1.1" 204 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875536
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875536%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875536: 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875537
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875537%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875537: 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875538
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875538%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875538: 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875539
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875539%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875539: 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875540
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875540%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875540: 0
2026-01-28 20:20:35 [ayvens.be] INFO: Found listing with ID: 1875541
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875541%27 HTTP/1.1" 200 None
2026-01-28 20:20:35 [ayvens.be] INFO: Scrape type for 1875541: 2
2026-01-28 20:20:35 [ayvens.be] INFO: Extracting data for car ID: 1875541
2026-01-28 20:20:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69465eb-6213-53fc-9ec7-750ff915fd56 with identifier: 1875541
2026-01-28 20:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69465eb-6213-53fc-9ec7-750ff915fd56 with scrape type 2
2026-01-28 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69465eb-6213-53fc-9ec7-750ff915fd56 with scrape type 2
2026-01-28 20:20:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b69465eb-6213-53fc-9ec7-750ff915fd56, identifier: 1875541
2026-01-28 20:20:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f48c50>
2026-01-28 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/14.jpg saved to cache
2026-01-28 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f37510>
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/15.jpg saved to cache
2026-01-28 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b69465eb-6213-53fc-9ec7-750ff915fd56 with identifier: 1875541
2026-01-28 20:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b69465eb-6213-53fc-9ec7-750ff915fd56 with identifier: 1875541
2026-01-28 20:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a5 sportback diesel - 2020', 'trim': '30 tdi business edition s tronic', 'title': 'audi a5 sportback diesel - 2020 30 tdi business edition s tronic', 'price': 0, 'odometer': 200885, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-20', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120', 'expiration_date': '2026-02-02t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 4, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b69465eb-6213-53fc-9ec7-750ff915fd56', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'audi a5 sportback diesel - 2020', 'sanitized_make': 'audi', 'odometer_in_km': 200885}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:30:00z',
     'fuel_type': 'diesel',
     'id': 'b69465eb-6213-53fc-9ec7-750ff915fd56',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a5 sportback diesel - 2020',
     'model': 'a5 sportback diesel - 2020',
     'odometer': 200885,
     'odometer_in_km': 200885,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-20',
     'sanitized_make': 'audi',
     'seats_number': 4,
     'seller_name': None,
     'title': 'audi a5 sportback diesel - 2020 30 tdi business edition s '
              'tronic',
     'transmission': 'automatic',
     'trim': '30 tdi business edition s tronic',
     'vin': None,
     'year': 2020}
2026-01-28 20:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: b69465eb-6213-53fc-9ec7-750ff915fd56 spider: ayvens.be
2026-01-28 20:20:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b69465eb-6213-53fc-9ec7-750ff915fd56 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a5 sportback diesel - 2020', 'trim': '30 tdi business edition s tronic', 'title': 'audi a5 sportback diesel - 2020 30 tdi business edition s tronic', 'price': 0, 'odometer': 200885, 'odometer_reading_unit': 'km', 'registration_date': '2020-11-20', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120', 'expiration_date': '2026-02-02t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 4, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b69465eb-6213-53fc-9ec7-750ff915fd56', 'current_year_diff': 6, 'age_in_months': 62, 'make_model': 'audi a5 sportback diesel - 2020', 'sanitized_make': 'audi', 'odometer_in_km': 200885}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 62,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:30:00z',
     'fuel_type': 'diesel',
     'id': 'b69465eb-6213-53fc-9ec7-750ff915fd56',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a5 sportback diesel - 2020',
     'model': 'a5 sportback diesel - 2020',
     'odometer': 200885,
     'odometer_in_km': 200885,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-20',
     'sanitized_make': 'audi',
     'seats_number': 4,
     'seller_name': None,
     'title': 'audi a5 sportback diesel - 2020 30 tdi business edition s '
              'tronic',
     'transmission': 'automatic',
     'trim': '30 tdi business edition s tronic',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b69465eb-6213-53fc-9ec7-750ff915fd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A5 SPORTBACK DIESEL - 2020',
 'odometer': 200885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'AUDI A5 SPORTBACK DIESEL - 2020 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875541%27 HTTP/1.1" 200 None
2026-01-28 20:20:36 [ayvens.be] INFO: Saving data for 1875541: {'auction_closing_time': 1770021000.0, 'created_time': 1769544275.007339, 'last_price_update_time': 1769631636.682193}
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875541') HTTP/1.1" 204 0
2026-01-28 20:20:36 [ayvens.be] INFO: Found listing with ID: 1875542
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875542%27 HTTP/1.1" 200 None
2026-01-28 20:20:36 [ayvens.be] INFO: Scrape type for 1875542: 2
2026-01-28 20:20:36 [ayvens.be] INFO: Extracting data for car ID: 1875542
2026-01-28 20:20:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44cba085-8b95-5049-854b-5b50629eb67c with identifier: 1875542
2026-01-28 20:20:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44cba085-8b95-5049-854b-5b50629eb67c with scrape type 2
2026-01-28 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44cba085-8b95-5049-854b-5b50629eb67c with scrape type 2
2026-01-28 20:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44cba085-8b95-5049-854b-5b50629eb67c, identifier: 1875542
2026-01-28 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44cba085-8b95-5049-854b-5b50629eb67c with identifier: 1875542
2026-01-28 20:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44cba085-8b95-5049-854b-5b50629eb67c with identifier: 1875542
2026-01-28 20:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 44cba085-8b95-5049-854b-5b50629eb67c with identifier: 1875542 to the API
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '44cba085-8b95-5049-854b-5b50629eb67c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 65616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 B4 D MHEV R-DESIGN AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D MHEV R-DESIGN AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875542%27 HTTP/1.1" 200 None
2026-01-28 20:20:37 [ayvens.be] INFO: Saving data for 1875542: {'auction_closing_time': 1770021000.0, 'created_time': 1769544266.072376, 'last_price_update_time': 1769631637.210442}
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875542') HTTP/1.1" 204 0
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0db6f90>
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/6.jpg saved to cache
2026-01-28 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:20:37 [ayvens.be] INFO: Found listing with ID: 1875543
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875543%27 HTTP/1.1" 200 None
2026-01-28 20:20:37 [ayvens.be] INFO: Scrape type for 1875543: 2
2026-01-28 20:20:37 [ayvens.be] INFO: Extracting data for car ID: 1875543
2026-01-28 20:20:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with identifier: 1875543
2026-01-28 20:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with scrape type 2
2026-01-28 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with scrape type 2
2026-01-28 20:20:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 85f2f7fd-86a4-5788-ae44-29fbb7f5e173, identifier: 1875543
2026-01-28 20:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with identifier: 1875543
2026-01-28 20:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with identifier: 1875543
2026-01-28 20:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 85f2f7fd-86a4-5788-ae44-29fbb7f5e173 with identifier: 1875543 to the API
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '85f2f7fd-86a4-5788-ae44-29fbb7f5e173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1-serie',
 'odometer': 106313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1-serie 1.5 118IA (100KW)',
 'transmission': 'automatic',
 'trim': '1.5 118IA (100KW)',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875543%27 HTTP/1.1" 200 None
2026-01-28 20:20:37 [ayvens.be] INFO: Saving data for 1875543: {'auction_closing_time': 1770021000.0, 'created_time': 1769544275.409474, 'last_price_update_time': 1769631637.847885}
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875543') HTTP/1.1" 204 0
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2de3a10>
2026-01-28 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yr%252F0cdc4a94e4f0494db9767f9f16ddb6b2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/5.jpg saved to cache
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306
2026-01-28 20:20:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4654a2f-7438-5b89-a0cd-ca6ae8d53306, skipping ID generation
2026-01-28 20:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with scrape type 1
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c4654a2f-7438-5b89-a0cd-ca6ae8d53306 from tracking dictionaries
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4654a2f-7438-5b89-a0cd-ca6ae8d53306 sending to next pipeline
2026-01-28 20:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4654a2f-7438-5b89-a0cd-ca6ae8d53306, identifier: 1878720
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e575d0>
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/9.jpg saved to cache
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:20:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875544
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875544%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875544: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875545
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875545%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875545: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875546
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875546%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875546: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875547
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875547%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875547: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875548
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875548%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875548: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875549
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875549%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875549: 0
2026-01-28 20:20:38 [ayvens.be] INFO: Found listing with ID: 1875550
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875550%27 HTTP/1.1" 200 None
2026-01-28 20:20:38 [ayvens.be] INFO: Scrape type for 1875550: 2
2026-01-28 20:20:38 [ayvens.be] INFO: Extracting data for car ID: 1875550
2026-01-28 20:20:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe with identifier: 1875550
2026-01-28 20:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9547cb-20e6-5183-8de7-9c45dc4d14fe with scrape type 2
2026-01-28 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9547cb-20e6-5183-8de7-9c45dc4d14fe with scrape type 2
2026-01-28 20:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe, identifier: 1875550
2026-01-28 20:20:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with identifier: 1878720
2026-01-28 20:20:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with identifier: 1878720
2026-01-28 20:20:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4654a2f-7438-5b89-a0cd-ca6ae8d53306 with identifier: 1878720 to the API
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c4654a2f-7438-5b89-a0cd-ca6ae8d53306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 76177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672629,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670158,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591951,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 665921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 642578,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 705105,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 536812,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672138,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 711567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605914,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621364,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612443,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 479576,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4654a2f-7438-5b89-a0cd-ca6ae8d53306/c4654a2f-7438-5b89-a0cd-ca6ae8d53306_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573118,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yr/0cdc4a94e4f0494db9767f9f16ddb6b2/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 330E (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 330E (135KW) BERLINE',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878720%27 HTTP/1.1" 200 None
2026-01-28 20:20:39 [ayvens.be] INFO: Saving data for 1878720: {'created_time': 1769631639.120165, 'last_price_update_time': 1769631639.120177, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878720') HTTP/1.1" 204 0
2026-01-28 20:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe with identifier: 1875550
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe with identifier: 1875550
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162386 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    162386
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe spider: ayvens.be
2026-01-28 20:20:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9f9547cb-20e6-5183-8de7-9c45dc4d14fe due to rule: high_mileage_for_country.json, error: 162386 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    162386
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9f9547cb-20e6-5183-8de7-9c45dc4d14fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 162386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 B3 MHEV PLUS DARK DCT',
 'transmission': 'automatic',
 'trim': '2.0 B3 MHEV PLUS DARK DCT',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875550%27 HTTP/1.1" 200 None
2026-01-28 20:20:39 [ayvens.be] INFO: Saving data for 1875550: {'auction_closing_time': 1770021000.0, 'created_time': 1769545148.518444, 'last_price_update_time': 1769631639.347752}
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875550') HTTP/1.1" 204 0
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f338d0>
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/9.jpg saved to cache
2026-01-28 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:20:39 [ayvens.be] INFO: Found listing with ID: 1875551
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875551%27 HTTP/1.1" 200 None
2026-01-28 20:20:39 [ayvens.be] INFO: Scrape type for 1875551: 2
2026-01-28 20:20:39 [ayvens.be] INFO: Extracting data for car ID: 1875551
2026-01-28 20:20:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a1dff3-68f8-5097-94c0-0a6371a1350b with identifier: 1875551
2026-01-28 20:20:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a1dff3-68f8-5097-94c0-0a6371a1350b with scrape type 2
2026-01-28 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43a1dff3-68f8-5097-94c0-0a6371a1350b with scrape type 2
2026-01-28 20:20:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43a1dff3-68f8-5097-94c0-0a6371a1350b, identifier: 1875551
2026-01-28 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43a1dff3-68f8-5097-94c0-0a6371a1350b with identifier: 1875551
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43a1dff3-68f8-5097-94c0-0a6371a1350b with identifier: 1875551
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159596 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159596
2026-01-28 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 43a1dff3-68f8-5097-94c0-0a6371a1350b spider: ayvens.be
2026-01-28 20:20:40 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 43a1dff3-68f8-5097-94c0-0a6371a1350b due to rule: high_mileage_for_country.json, error: 159596 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159596
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '43a1dff3-68f8-5097-94c0-0a6371a1350b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 159596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI ACT Ambition (EU6.2)',
 'transmission': 'manual',
 'trim': '1.5 TSI ACT Ambition (EU6.2)',
 'vin': None,
 'year': 2018}
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875551%27 HTTP/1.1" 200 None
2026-01-28 20:20:40 [ayvens.be] INFO: Saving data for 1875551: {'auction_closing_time': 1770021000.0, 'created_time': 1769545145.90216, 'last_price_update_time': 1769631640.052467}
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875551') HTTP/1.1" 204 0
2026-01-28 20:20:40 [ayvens.be] INFO: Found listing with ID: 1875552
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875552%27 HTTP/1.1" 200 None
2026-01-28 20:20:40 [ayvens.be] INFO: Scrape type for 1875552: 2
2026-01-28 20:20:40 [ayvens.be] INFO: Extracting data for car ID: 1875552
2026-01-28 20:20:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with identifier: 1875552
2026-01-28 20:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with scrape type 2
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with scrape type 2
2026-01-28 20:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4, identifier: 1875552
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a96d0>
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2au%252Ffb5533c5d52042cb89892c18c878c2da%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/2.jpg saved to cache
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313
2026-01-28 20:20:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2af1fddd-808b-5ad5-ba8c-f5c07c880313, skipping ID generation
2026-01-28 20:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with scrape type 1
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2af1fddd-808b-5ad5-ba8c-f5c07c880313 from tracking dictionaries
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2af1fddd-808b-5ad5-ba8c-f5c07c880313 sending to next pipeline
2026-01-28 20:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2af1fddd-808b-5ad5-ba8c-f5c07c880313, identifier: 1878719
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d6ee10>
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bx%252F15ca061022d846828280f3c082c5ddc4%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/15.jpg saved to cache
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c345767d-6895-556e-91e7-965d509236f2
2026-01-28 20:20:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c345767d-6895-556e-91e7-965d509236f2, skipping ID generation
2026-01-28 20:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c345767d-6895-556e-91e7-965d509236f2 with scrape type 1
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c345767d-6895-556e-91e7-965d509236f2 from tracking dictionaries
2026-01-28 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c345767d-6895-556e-91e7-965d509236f2 sending to next pipeline
2026-01-28 20:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c345767d-6895-556e-91e7-965d509236f2, identifier: 1878717
2026-01-28 20:20:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with identifier: 1875552
2026-01-28 20:20:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with identifier: 1875552
2026-01-28 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8bb85438-68e4-5ad9-83c4-a35cefb9c2a4 with identifier: 1875552 to the API
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '8bb85438-68e4-5ad9-83c4-a35cefb9c2a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'ENYAQ',
 'odometer': 28706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA ENYAQ 82KWH IV 80',
 'transmission': 'automatic',
 'trim': '82KWH IV 80',
 'vin': None,
 'year': 2024}
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875552%27 HTTP/1.1" 200 None
2026-01-28 20:20:41 [ayvens.be] INFO: Saving data for 1875552: {'auction_closing_time': 1770021000.0, 'created_time': 1769545144.851687, 'last_price_update_time': 1769631641.238808}
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875552') HTTP/1.1" 204 0
2026-01-28 20:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with identifier: 1878719
2026-01-28 20:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with identifier: 1878719
2026-01-28 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2af1fddd-808b-5ad5-ba8c-f5c07c880313 with identifier: 1878719 to the API
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2af1fddd-808b-5ad5-ba8c-f5c07c880313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 78423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612820,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659207,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509468,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671052,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 549602,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 656365,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589160,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646231,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 680020,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 707261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687597,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 548297,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2af1fddd-808b-5ad5-ba8c-f5c07c880313/2af1fddd-808b-5ad5-ba8c-f5c07c880313_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634329,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2au/fb5533c5d52042cb89892c18c878c2da/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 180 BUSINESS SOLUTION',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878719%27 HTTP/1.1" 200 None
2026-01-28 20:20:41 [ayvens.be] INFO: Saving data for 1878719: {'created_time': 1769631641.747336, 'last_price_update_time': 1769631641.747346, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878719') HTTP/1.1" 204 0
2026-01-28 20:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c345767d-6895-556e-91e7-965d509236f2 with identifier: 1878717
2026-01-28 20:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c345767d-6895-556e-91e7-965d509236f2 with identifier: 1878717
2026-01-28 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c345767d-6895-556e-91e7-965d509236f2 with identifier: 1878717 to the API
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c345767d-6895-556e-91e7-965d509236f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'YARIS',
 'odometer': 68087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660525,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675102,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722547,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547757,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 572711,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545993,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527685,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477414,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524608,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567101,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345767d-6895-556e-91e7-965d509236f2/c345767d-6895-556e-91e7-965d509236f2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500938,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bx/15ca061022d846828280f3c082c5ddc4/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA YARIS 1.5 VVT-I HEV DYNAMIC E-CVT',
 'transmission': 'automatic',
 'trim': '1.5 VVT-I HEV DYNAMIC E-CVT',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878717%27 HTTP/1.1" 200 None
2026-01-28 20:20:42 [ayvens.be] INFO: Saving data for 1878717: {'created_time': 1769631642.069706, 'last_price_update_time': 1769631642.069717, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878717') HTTP/1.1" 204 0
2026-01-28 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:42 [ayvens.be] INFO: Found listing with ID: 1875553
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875553%27 HTTP/1.1" 200 None
2026-01-28 20:20:42 [ayvens.be] INFO: Scrape type for 1875553: 2
2026-01-28 20:20:42 [ayvens.be] INFO: Extracting data for car ID: 1875553
2026-01-28 20:20:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06a4d300-4dfc-53d6-86be-a12e9c3285bd with identifier: 1875553
2026-01-28 20:20:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06a4d300-4dfc-53d6-86be-a12e9c3285bd with scrape type 2
2026-01-28 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06a4d300-4dfc-53d6-86be-a12e9c3285bd with scrape type 2
2026-01-28 20:20:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06a4d300-4dfc-53d6-86be-a12e9c3285bd, identifier: 1875553
2026-01-28 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06a4d300-4dfc-53d6-86be-a12e9c3285bd with identifier: 1875553
2026-01-28 20:20:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06a4d300-4dfc-53d6-86be-a12e9c3285bd with identifier: 1875553
2026-01-28 20:20:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132099 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132099
2026-01-28 20:20:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 06a4d300-4dfc-53d6-86be-a12e9c3285bd spider: ayvens.be
2026-01-28 20:20:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 06a4d300-4dfc-53d6-86be-a12e9c3285bd due to rule: high_mileage_for_country.json, error: 132099 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132099
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '06a4d300-4dfc-53d6-86be-a12e9c3285bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 132099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 1.5 BLUEHDI 75KW S-S GT',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S GT',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875553%27 HTTP/1.1" 200 None
2026-01-28 20:20:42 [ayvens.be] INFO: Saving data for 1875553: {'auction_closing_time': 1770021000.0, 'created_time': 1769545145.076324, 'last_price_update_time': 1769631642.416843}
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875553') HTTP/1.1" 204 0
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f39b90>
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ad%252Fc24faef129484a82a16695a1996a2d2a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/8.jpg saved to cache
2026-01-28 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e
2026-01-28 20:20:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3147250c-5aa8-59df-af2c-b55adc3a2a1e, skipping ID generation
2026-01-28 20:20:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e with scrape type 1
2026-01-28 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3147250c-5aa8-59df-af2c-b55adc3a2a1e from tracking dictionaries
2026-01-28 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3147250c-5aa8-59df-af2c-b55adc3a2a1e sending to next pipeline
2026-01-28 20:20:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3147250c-5aa8-59df-af2c-b55adc3a2a1e, identifier: 1878691
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e1c210>
2026-01-28 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/6.jpg saved to cache
2026-01-28 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:43 [ayvens.be] INFO: Found listing with ID: 1875554
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875554%27 HTTP/1.1" 200 None
2026-01-28 20:20:43 [ayvens.be] INFO: Scrape type for 1875554: 2
2026-01-28 20:20:43 [ayvens.be] INFO: Extracting data for car ID: 1875554
2026-01-28 20:20:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e36431-1ad8-5922-8d7c-5045a1e16e98 with identifier: 1875554
2026-01-28 20:20:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e36431-1ad8-5922-8d7c-5045a1e16e98 with scrape type 2
2026-01-28 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03e36431-1ad8-5922-8d7c-5045a1e16e98 with scrape type 2
2026-01-28 20:20:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 03e36431-1ad8-5922-8d7c-5045a1e16e98, identifier: 1875554
2026-01-28 20:20:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3147250c-5aa8-59df-af2c-b55adc3a2a1e with identifier: 1878691
2026-01-28 20:20:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3147250c-5aa8-59df-af2c-b55adc3a2a1e with identifier: 1878691
2026-01-28 20:20:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3147250c-5aa8-59df-af2c-b55adc3a2a1e with identifier: 1878691 to the API
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '3147250c-5aa8-59df-af2c-b55adc3a2a1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 56731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 520266,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531004,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591111,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569601,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545396,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 628553,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704655,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 805017,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 633876,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746527,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574257,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 630156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 547232,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3147250c-5aa8-59df-af2c-b55adc3a2a1e/3147250c-5aa8-59df-af2c-b55adc3a2a1e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672261,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ad/c24faef129484a82a16695a1996a2d2a/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 318DA (110KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 318DA (110KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878691%27 HTTP/1.1" 200 None
2026-01-28 20:20:43 [ayvens.be] INFO: Saving data for 1878691: {'created_time': 1769631643.655995, 'last_price_update_time': 1769631643.656006, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878691') HTTP/1.1" 204 0
2026-01-28 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 03e36431-1ad8-5922-8d7c-5045a1e16e98 with identifier: 1875554
2026-01-28 20:20:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 03e36431-1ad8-5922-8d7c-5045a1e16e98 with identifier: 1875554
2026-01-28 20:20:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 03e36431-1ad8-5922-8d7c-5045a1e16e98 with identifier: 1875554 to the API
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '03e36431-1ad8-5922-8d7c-5045a1e16e98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '5-serie',
 'odometer': 56149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5-serie 2.0 530E TOURING AUTO',
 'transmission': 'automatic',
 'trim': '2.0 530E TOURING AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875554%27 HTTP/1.1" 200 None
2026-01-28 20:20:43 [ayvens.be] INFO: Saving data for 1875554: {'auction_closing_time': 1770021000.0, 'created_time': 1769544392.031198, 'last_price_update_time': 1769631643.944382}
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875554') HTTP/1.1" 204 0
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0cf50>
2026-01-28 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/5.jpg saved to cache
2026-01-28 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:20:44 [ayvens.be] INFO: Found listing with ID: 1875555
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875555%27 HTTP/1.1" 200 None
2026-01-28 20:20:44 [ayvens.be] INFO: Scrape type for 1875555: 2
2026-01-28 20:20:44 [ayvens.be] INFO: Extracting data for car ID: 1875555
2026-01-28 20:20:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5e5655a-2417-5851-a625-7e53f5cb89bc with identifier: 1875555
2026-01-28 20:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5e5655a-2417-5851-a625-7e53f5cb89bc with scrape type 2
2026-01-28 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5e5655a-2417-5851-a625-7e53f5cb89bc with scrape type 2
2026-01-28 20:20:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5e5655a-2417-5851-a625-7e53f5cb89bc, identifier: 1875555
2026-01-28 20:20:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5e5655a-2417-5851-a625-7e53f5cb89bc with identifier: 1875555
2026-01-28 20:20:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5e5655a-2417-5851-a625-7e53f5cb89bc with identifier: 1875555
2026-01-28 20:20:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e5e5655a-2417-5851-a625-7e53f5cb89bc with identifier: 1875555 to the API
2026-01-28 20:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e5e5655a-2417-5851-a625-7e53f5cb89bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 104510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 2.0 30 TDI 85KW ADVANCED',
 'transmission': 'manual',
 'trim': '2.0 30 TDI 85KW ADVANCED',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875555%27 HTTP/1.1" 200 None
2026-01-28 20:20:45 [ayvens.be] INFO: Saving data for 1875555: {'auction_closing_time': 1770021000.0, 'created_time': 1769544341.955241, 'last_price_update_time': 1769631645.673111}
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875555') HTTP/1.1" 204 0
2026-01-28 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:45 [ayvens.be] INFO: Found listing with ID: 1875556
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875556%27 HTTP/1.1" 200 None
2026-01-28 20:20:45 [ayvens.be] INFO: Scrape type for 1875556: 2
2026-01-28 20:20:45 [ayvens.be] INFO: Extracting data for car ID: 1875556
2026-01-28 20:20:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5262987-d025-5a82-8f1d-0dfae2f5a0af with identifier: 1875556
2026-01-28 20:20:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5262987-d025-5a82-8f1d-0dfae2f5a0af with scrape type 2
2026-01-28 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5262987-d025-5a82-8f1d-0dfae2f5a0af with scrape type 2
2026-01-28 20:20:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f5262987-d025-5a82-8f1d-0dfae2f5a0af, identifier: 1875556
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad8e07450>
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2em%252Fc7b7644c62c44141a5deb1802c198a23%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/4.jpg saved to cache
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39cb89de-8d59-5ce4-8497-fb6977f510a8
2026-01-28 20:20:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39cb89de-8d59-5ce4-8497-fb6977f510a8, skipping ID generation
2026-01-28 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39cb89de-8d59-5ce4-8497-fb6977f510a8 with scrape type 1
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 39cb89de-8d59-5ce4-8497-fb6977f510a8 from tracking dictionaries
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39cb89de-8d59-5ce4-8497-fb6977f510a8 sending to next pipeline
2026-01-28 20:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39cb89de-8d59-5ce4-8497-fb6977f510a8, identifier: 1878690
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e2d650>
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2da%252F46151fc0a36e4316bc58d4e072d3c630%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/10.jpg saved to cache
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a0d771c-06dc-5b61-99c3-afa605d917e3
2026-01-28 20:20:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a0d771c-06dc-5b61-99c3-afa605d917e3, skipping ID generation
2026-01-28 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0d771c-06dc-5b61-99c3-afa605d917e3 with scrape type 1
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7a0d771c-06dc-5b61-99c3-afa605d917e3 from tracking dictionaries
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a0d771c-06dc-5b61-99c3-afa605d917e3 sending to next pipeline
2026-01-28 20:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a0d771c-06dc-5b61-99c3-afa605d917e3, identifier: 1878718
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31a87d0>
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ch%252F315f1c013b344116afaead60449ceceb%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/15.jpg saved to cache
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4b4f0794-824d-5b17-92c8-fe603afae84b
2026-01-28 20:20:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b4f0794-824d-5b17-92c8-fe603afae84b, skipping ID generation
2026-01-28 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b4f0794-824d-5b17-92c8-fe603afae84b with scrape type 1
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b4f0794-824d-5b17-92c8-fe603afae84b from tracking dictionaries
2026-01-28 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b4f0794-824d-5b17-92c8-fe603afae84b sending to next pipeline
2026-01-28 20:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4b4f0794-824d-5b17-92c8-fe603afae84b, identifier: 1878688
2026-01-28 20:20:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f5262987-d025-5a82-8f1d-0dfae2f5a0af with identifier: 1875556
2026-01-28 20:20:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f5262987-d025-5a82-8f1d-0dfae2f5a0af with identifier: 1875556
2026-01-28 20:20:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f5262987-d025-5a82-8f1d-0dfae2f5a0af with identifier: 1875556 to the API
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f5262987-d025-5a82-8f1d-0dfae2f5a0af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 56224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875556%27 HTTP/1.1" 200 None
2026-01-28 20:20:47 [ayvens.be] INFO: Saving data for 1875556: {'auction_closing_time': 1770021000.0, 'created_time': 1769544351.806483, 'last_price_update_time': 1769631647.197172}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875556') HTTP/1.1" 204 0
2026-01-28 20:20:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39cb89de-8d59-5ce4-8497-fb6977f510a8 with identifier: 1878690
2026-01-28 20:20:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39cb89de-8d59-5ce4-8497-fb6977f510a8 with identifier: 1878690
2026-01-28 20:20:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 39cb89de-8d59-5ce4-8497-fb6977f510a8 with identifier: 1878690 to the API
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '39cb89de-8d59-5ce4-8497-fb6977f510a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'COROLLA CROSS',
 'odometer': 16489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619291,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608913,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673548,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644587,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576041,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 579511,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598083,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651584,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 532092,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396567,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737382,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540908,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531296,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39cb89de-8d59-5ce4-8497-fb6977f510a8/39cb89de-8d59-5ce4-8497-fb6977f510a8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589675,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2em/c7b7644c62c44141a5deb1802c198a23/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA COROLLA CROSS 2.0 HEV PREMIUM E-CVT',
 'transmission': 'automatic',
 'trim': '2.0 HEV PREMIUM E-CVT',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878690%27 HTTP/1.1" 200 None
2026-01-28 20:20:47 [ayvens.be] INFO: Saving data for 1878690: {'created_time': 1769631647.549553, 'last_price_update_time': 1769631647.549563, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878690') HTTP/1.1" 204 0
2026-01-28 20:20:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a0d771c-06dc-5b61-99c3-afa605d917e3 with identifier: 1878718
2026-01-28 20:20:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a0d771c-06dc-5b61-99c3-afa605d917e3 with identifier: 1878718
2026-01-28 20:20:47 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7a0d771c-06dc-5b61-99c3-afa605d917e3 with identifier: 1878718 to the API
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/10.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7a0d771c-06dc-5b61-99c3-afa605d917e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 80939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644473,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601375,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676903,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691204,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663627,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721402,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 677746,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553324,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 660787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553964,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580117,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 674395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586626,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0d771c-06dc-5b61-99c3-afa605d917e3/7a0d771c-06dc-5b61-99c3-afa605d917e3_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567470,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2da/46151fc0a36e4316bc58d4e072d3c630/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS LINE DCT SH '
          'BR',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS LINE DCT SH BR',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878718%27 HTTP/1.1" 200 None
2026-01-28 20:20:47 [ayvens.be] INFO: Saving data for 1878718: {'created_time': 1769631647.90881, 'last_price_update_time': 1769631647.908819, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878718') HTTP/1.1" 204 0
2026-01-28 20:20:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4b4f0794-824d-5b17-92c8-fe603afae84b with identifier: 1878688
2026-01-28 20:20:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4b4f0794-824d-5b17-92c8-fe603afae84b with identifier: 1878688
2026-01-28 20:20:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4b4f0794-824d-5b17-92c8-fe603afae84b with identifier: 1878688 to the API
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4b4f0794-824d-5b17-92c8-fe603afae84b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': "CEE'D",
 'odometer': 49345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 557405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 514693,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533366,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 491227,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722928,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 748997,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 869167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751153,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 592747,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716137,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668724,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582880,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489011,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b4f0794-824d-5b17-92c8-fe603afae84b/4b4f0794-824d-5b17-92c8-fe603afae84b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591284,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ch/315f1c013b344116afaead60449ceceb/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': "KIA CEE'D 1.0 T-GDI PULSE",
 'transmission': 'manual',
 'trim': '1.0 T-GDI PULSE',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878688%27 HTTP/1.1" 200 None
2026-01-28 20:20:48 [ayvens.be] INFO: Saving data for 1878688: {'created_time': 1769631648.287664, 'last_price_update_time': 1769631648.287677, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878688') HTTP/1.1" 204 0
2026-01-28 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:48 [ayvens.be] INFO: Found listing with ID: 1875557
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875557%27 HTTP/1.1" 200 None
2026-01-28 20:20:48 [ayvens.be] INFO: Scrape type for 1875557: 2
2026-01-28 20:20:48 [ayvens.be] INFO: Extracting data for car ID: 1875557
2026-01-28 20:20:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 467a3d6f-c271-5061-b3c2-f088efbccb4d with identifier: 1875557
2026-01-28 20:20:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 467a3d6f-c271-5061-b3c2-f088efbccb4d with scrape type 2
2026-01-28 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 467a3d6f-c271-5061-b3c2-f088efbccb4d with scrape type 2
2026-01-28 20:20:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 467a3d6f-c271-5061-b3c2-f088efbccb4d, identifier: 1875557
2026-01-28 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 467a3d6f-c271-5061-b3c2-f088efbccb4d with identifier: 1875557
2026-01-28 20:20:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 467a3d6f-c271-5061-b3c2-f088efbccb4d with identifier: 1875557
2026-01-28 20:20:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 467a3d6f-c271-5061-b3c2-f088efbccb4d with identifier: 1875557 to the API
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '467a3d6f-c271-5061-b3c2-f088efbccb4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK - 2017',
 'odometer': 95314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK - 2017 30 TFSI (EU6d-TEMP) STOCK',
 'transmission': 'manual',
 'trim': '30 TFSI (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875557%27 HTTP/1.1" 200 None
2026-01-28 20:20:48 [ayvens.be] INFO: Saving data for 1875557: {'auction_closing_time': 1770021000.0, 'created_time': 1769544389.633251, 'last_price_update_time': 1769631648.718794}
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875557') HTTP/1.1" 204 0
2026-01-28 20:20:48 [ayvens.be] INFO: Found listing with ID: 1875558
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875558%27 HTTP/1.1" 200 None
2026-01-28 20:20:48 [ayvens.be] INFO: Scrape type for 1875558: 2
2026-01-28 20:20:48 [ayvens.be] INFO: Extracting data for car ID: 1875558
2026-01-28 20:20:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f942eb46-fbc9-58f0-8df7-3acc204856c8 with identifier: 1875558
2026-01-28 20:20:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f942eb46-fbc9-58f0-8df7-3acc204856c8 with scrape type 2
2026-01-28 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f942eb46-fbc9-58f0-8df7-3acc204856c8 with scrape type 2
2026-01-28 20:20:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f942eb46-fbc9-58f0-8df7-3acc204856c8, identifier: 1875558
2026-01-28 20:20:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e56e50>
2026-01-28 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yj%252F9f446e520bd54dcd8477eaaa01e8c374%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/2.jpg saved to cache
2026-01-28 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a726024a-70b2-5969-9136-93cb24a2e126
2026-01-28 20:20:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a726024a-70b2-5969-9136-93cb24a2e126, skipping ID generation
2026-01-28 20:20:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a726024a-70b2-5969-9136-93cb24a2e126 with scrape type 1
2026-01-28 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a726024a-70b2-5969-9136-93cb24a2e126 from tracking dictionaries
2026-01-28 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a726024a-70b2-5969-9136-93cb24a2e126 sending to next pipeline
2026-01-28 20:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a726024a-70b2-5969-9136-93cb24a2e126, identifier: 1878667
2026-01-28 20:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f942eb46-fbc9-58f0-8df7-3acc204856c8 with identifier: 1875558
2026-01-28 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f942eb46-fbc9-58f0-8df7-3acc204856c8 with identifier: 1875558
2026-01-28 20:20:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f942eb46-fbc9-58f0-8df7-3acc204856c8 with identifier: 1875558 to the API
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'f942eb46-fbc9-58f0-8df7-3acc204856c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 29293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE PRO',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE PRO',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875558%27 HTTP/1.1" 200 None
2026-01-28 20:20:49 [ayvens.be] INFO: Saving data for 1875558: {'auction_closing_time': 1770021000.0, 'created_time': 1769544388.525631, 'last_price_update_time': 1769631649.560181}
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875558') HTTP/1.1" 204 0
2026-01-28 20:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a726024a-70b2-5969-9136-93cb24a2e126 with identifier: 1878667
2026-01-28 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a726024a-70b2-5969-9136-93cb24a2e126 with identifier: 1878667
2026-01-28 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169600 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    169600
2026-01-28 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a726024a-70b2-5969-9136-93cb24a2e126 spider: ayvens.be
2026-01-28 20:20:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a726024a-70b2-5969-9136-93cb24a2e126 due to rule: high_mileage_for_country.json, error: 169600 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    169600
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a726024a-70b2-5969-9136-93cb24a2e126',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'TOYOTA',
 'model': 'RAV4',
 'odometer': 169600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668745,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 661528,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616247,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658779,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 604308,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685035,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593873,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653637,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618060,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 591806,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 652483,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 535209,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668309,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679799,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599581,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567819,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631701,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a726024a-70b2-5969-9136-93cb24a2e126/a726024a-70b2-5969-9136-93cb24a2e126_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531177,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yj/9f446e520bd54dcd8477eaaa01e8c374/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TOYOTA RAV4 2.5 HYBRID DYNAMIC PLUS E-CVT',
 'transmission': 'automatic',
 'trim': '2.5 HYBRID DYNAMIC PLUS E-CVT',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878667%27 HTTP/1.1" 200 None
2026-01-28 20:20:49 [ayvens.be] INFO: Saving data for 1878667: {'created_time': 1769631649.802656, 'last_price_update_time': 1769631649.802671, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878667') HTTP/1.1" 204 0
2026-01-28 20:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:49 [ayvens.be] INFO: Found listing with ID: 1875559
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875559%27 HTTP/1.1" 200 None
2026-01-28 20:20:49 [ayvens.be] INFO: Scrape type for 1875559: 2
2026-01-28 20:20:49 [ayvens.be] INFO: Extracting data for car ID: 1875559
2026-01-28 20:20:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e0038d-a63f-5968-a04d-f2e751f68885 with identifier: 1875559
2026-01-28 20:20:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e0038d-a63f-5968-a04d-f2e751f68885 with scrape type 2
2026-01-28 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e0038d-a63f-5968-a04d-f2e751f68885 with scrape type 2
2026-01-28 20:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c6e0038d-a63f-5968-a04d-f2e751f68885, identifier: 1875559
2026-01-28 20:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c6e0038d-a63f-5968-a04d-f2e751f68885 with identifier: 1875559
2026-01-28 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c6e0038d-a63f-5968-a04d-f2e751f68885 with identifier: 1875559
2026-01-28 20:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c6e0038d-a63f-5968-a04d-f2e751f68885 with identifier: 1875559 to the API
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c6e0038d-a63f-5968-a04d-f2e751f68885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON DIESEL',
 'odometer': 112771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON DIESEL 2.0 TDi SCR Elegance (EU6.2)',
 'transmission': 'manual',
 'trim': '2.0 TDi SCR Elegance (EU6.2)',
 'vin': None,
 'year': 2019}
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875559%27 HTTP/1.1" 200 None
2026-01-28 20:20:50 [ayvens.be] INFO: Saving data for 1875559: {'auction_closing_time': 1770021000.0, 'created_time': 1769544385.477091, 'last_price_update_time': 1769631650.211989}
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875559') HTTP/1.1" 204 0
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d86190>
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/9.jpg saved to cache
2026-01-28 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0d66750>
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/10.jpg saved to cache
2026-01-28 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:50 [ayvens.be] INFO: Found listing with ID: 1875560
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875560%27 HTTP/1.1" 200 None
2026-01-28 20:20:50 [ayvens.be] INFO: Scrape type for 1875560: 2
2026-01-28 20:20:50 [ayvens.be] INFO: Extracting data for car ID: 1875560
2026-01-28 20:20:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with identifier: 1875560
2026-01-28 20:20:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with scrape type 2
2026-01-28 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with scrape type 2
2026-01-28 20:20:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f, identifier: 1875560
2026-01-28 20:20:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with identifier: 1875560
2026-01-28 20:20:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with identifier: 1875560
2026-01-28 20:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 80ca83ed-0101-5a6e-a37a-fe5843cdaa8f with identifier: 1875560 to the API
2026-01-28 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '80ca83ed-0101-5a6e-a37a-fe5843cdaa8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 79238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 2.0 CLA 180 D BUSINESS SOLUTION LUXURY AUT',
 'transmission': 'automatic',
 'trim': '2.0 CLA 180 D BUSINESS SOLUTION LUXURY AUT',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875560%27 HTTP/1.1" 200 None
2026-01-28 20:20:51 [ayvens.be] INFO: Saving data for 1875560: {'auction_closing_time': 1770021000.0, 'created_time': 1769544379.997054, 'last_price_update_time': 1769631651.147229}
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875560') HTTP/1.1" 204 0
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ee1150>
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bm%252F949a9c02c82c4a55a7e3d2e55d67951b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/8.jpg saved to cache
2026-01-28 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab
2026-01-28 20:20:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1e4ee92-a0df-5963-97bf-43c8a16f13ab, skipping ID generation
2026-01-28 20:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab with scrape type 1
2026-01-28 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f1e4ee92-a0df-5963-97bf-43c8a16f13ab from tracking dictionaries
2026-01-28 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1e4ee92-a0df-5963-97bf-43c8a16f13ab sending to next pipeline
2026-01-28 20:20:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f1e4ee92-a0df-5963-97bf-43c8a16f13ab, identifier: 1878666
2026-01-28 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:51 [ayvens.be] INFO: Found listing with ID: 1875561
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875561%27 HTTP/1.1" 200 None
2026-01-28 20:20:51 [ayvens.be] INFO: Scrape type for 1875561: 2
2026-01-28 20:20:51 [ayvens.be] INFO: Extracting data for car ID: 1875561
2026-01-28 20:20:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af23a37a-7c7c-5515-8109-12ca088406ad with identifier: 1875561
2026-01-28 20:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af23a37a-7c7c-5515-8109-12ca088406ad with scrape type 2
2026-01-28 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af23a37a-7c7c-5515-8109-12ca088406ad with scrape type 2
2026-01-28 20:20:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af23a37a-7c7c-5515-8109-12ca088406ad, identifier: 1875561
2026-01-28 20:20:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f1e4ee92-a0df-5963-97bf-43c8a16f13ab with identifier: 1878666
2026-01-28 20:20:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f1e4ee92-a0df-5963-97bf-43c8a16f13ab with identifier: 1878666
2026-01-28 20:20:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f1e4ee92-a0df-5963-97bf-43c8a16f13ab with identifier: 1878666 to the API
2026-01-28 20:20:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f1e4ee92-a0df-5963-97bf-43c8a16f13ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS GLC COUPE DIESEL (C253)',
 'odometer': 76652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655934,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 620016,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646782,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715186,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 559538,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 637753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618498,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727987,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 464054,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 708900,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 566773,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511754,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 537835,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560249,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1e4ee92-a0df-5963-97bf-43c8a16f13ab/f1e4ee92-a0df-5963-97bf-43c8a16f13ab_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 599363,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bm/949a9c02c82c4a55a7e3d2e55d67951b/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS GLC COUPE DIESEL (C253) GLC 200 d',
 'transmission': 'automatic',
 'trim': 'GLC 200 d',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878666%27 HTTP/1.1" 200 None
2026-01-28 20:20:52 [ayvens.be] INFO: Saving data for 1878666: {'created_time': 1769631652.13085, 'last_price_update_time': 1769631652.130862, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878666') HTTP/1.1" 204 0
2026-01-28 20:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af23a37a-7c7c-5515-8109-12ca088406ad with identifier: 1875561
2026-01-28 20:20:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af23a37a-7c7c-5515-8109-12ca088406ad with identifier: 1875561
2026-01-28 20:20:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: af23a37a-7c7c-5515-8109-12ca088406ad with identifier: 1875561 to the API
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'af23a37a-7c7c-5515-8109-12ca088406ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 50217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.5 BLUEHDI 96KW S-S ALLURE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 96KW S-S ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875561%27 HTTP/1.1" 200 None
2026-01-28 20:20:52 [ayvens.be] INFO: Saving data for 1875561: {'auction_closing_time': 1770021000.0, 'created_time': 1769544378.320892, 'last_price_update_time': 1769631652.438112}
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875561') HTTP/1.1" 204 0
2026-01-28 20:20:52 [ayvens.be] INFO: Found listing with ID: 1875562
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875562%27 HTTP/1.1" 200 None
2026-01-28 20:20:52 [ayvens.be] INFO: Scrape type for 1875562: 2
2026-01-28 20:20:52 [ayvens.be] INFO: Extracting data for car ID: 1875562
2026-01-28 20:20:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with identifier: 1875562
2026-01-28 20:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with scrape type 2
2026-01-28 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with scrape type 2
2026-01-28 20:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 137662fc-eb0b-5f2c-a455-e2f9b0eb34de, identifier: 1875562
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31ab210>
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/18.jpg saved to cache
2026-01-28 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e4b2d0>
2026-01-28 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/12.jpg saved to cache
2026-01-28 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with identifier: 1875562
2026-01-28 20:20:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with identifier: 1875562
2026-01-28 20:20:53 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 137662fc-eb0b-5f2c-a455-e2f9b0eb34de with identifier: 1875562 to the API
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '137662fc-eb0b-5f2c-a455-e2f9b0eb34de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 51639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 B4 D MHEV CORE AUTO',
 'transmission': 'automatic',
 'trim': '2.0 B4 D MHEV CORE AUTO',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875562%27 HTTP/1.1" 200 None
2026-01-28 20:20:53 [ayvens.be] INFO: Saving data for 1875562: {'auction_closing_time': 1770021000.0, 'created_time': 1769544386.296989, 'last_price_update_time': 1769631653.469876}
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875562') HTTP/1.1" 204 0
2026-01-28 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/20.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:53 [ayvens.be] INFO: Found listing with ID: 1875563
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875563%27 HTTP/1.1" 200 None
2026-01-28 20:20:53 [ayvens.be] INFO: Scrape type for 1875563: 2
2026-01-28 20:20:53 [ayvens.be] INFO: Extracting data for car ID: 1875563
2026-01-28 20:20:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f9820f-b472-5039-a599-4c1fa8624bb1 with identifier: 1875563
2026-01-28 20:20:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f9820f-b472-5039-a599-4c1fa8624bb1 with scrape type 2
2026-01-28 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37f9820f-b472-5039-a599-4c1fa8624bb1 with scrape type 2
2026-01-28 20:20:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 37f9820f-b472-5039-a599-4c1fa8624bb1, identifier: 1875563
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f83bd0>
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/10.jpg saved to cache
2026-01-28 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f421d0>
2026-01-28 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/11.jpg saved to cache
2026-01-28 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 37f9820f-b472-5039-a599-4c1fa8624bb1 with identifier: 1875563
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 37f9820f-b472-5039-a599-4c1fa8624bb1 with identifier: 1875563
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152621 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152621
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 37f9820f-b472-5039-a599-4c1fa8624bb1 spider: ayvens.be
2026-01-28 20:20:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 37f9820f-b472-5039-a599-4c1fa8624bb1 due to rule: high_mileage_for_country.json, error: 152621 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152621
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '37f9820f-b472-5039-a599-4c1fa8624bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 152621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.2 PureTech Shine S&S',
 'transmission': 'manual',
 'trim': '1.2 PureTech Shine S&S',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875563%27 HTTP/1.1" 200 None
2026-01-28 20:20:54 [ayvens.be] INFO: Saving data for 1875563: {'auction_closing_time': 1770021000.0, 'created_time': 1769544396.0534, 'last_price_update_time': 1769631654.419778}
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875563') HTTP/1.1" 204 0
2026-01-28 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:54 [ayvens.be] INFO: Found listing with ID: 1875564
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875564%27 HTTP/1.1" 200 None
2026-01-28 20:20:54 [ayvens.be] INFO: Scrape type for 1875564: 2
2026-01-28 20:20:54 [ayvens.be] INFO: Extracting data for car ID: 1875564
2026-01-28 20:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94dc48e-696d-50b3-b139-f88d310224df with identifier: 1875564
2026-01-28 20:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94dc48e-696d-50b3-b139-f88d310224df with scrape type 2
2026-01-28 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94dc48e-696d-50b3-b139-f88d310224df with scrape type 2
2026-01-28 20:20:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b94dc48e-696d-50b3-b139-f88d310224df, identifier: 1875564
2026-01-28 20:20:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b94dc48e-696d-50b3-b139-f88d310224df with identifier: 1875564
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b94dc48e-696d-50b3-b139-f88d310224df with identifier: 1875564
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
2026-01-28 20:20:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b94dc48e-696d-50b3-b139-f88d310224df spider: ayvens.be
2026-01-28 20:20:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b94dc48e-696d-50b3-b139-f88d310224df due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b94dc48e-696d-50b3-b139-f88d310224df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC',
 'odometer': 95371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 2.0 DCI 96KW CONFORT LWB 3.0T',
 'transmission': 'manual',
 'trim': '2.0 DCI 96KW CONFORT LWB 3.0T',
 'vin': None,
 'year': 2023}
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875564%27 HTTP/1.1" 200 None
2026-01-28 20:20:54 [ayvens.be] INFO: Saving data for 1875564: {'auction_closing_time': 1770021000.0, 'created_time': 1769544775.06932, 'last_price_update_time': 1769631654.920717}
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875564') HTTP/1.1" 204 0
2026-01-28 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:54 [ayvens.be] INFO: Found listing with ID: 1875565
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875565%27 HTTP/1.1" 200 None
2026-01-28 20:20:54 [ayvens.be] INFO: Scrape type for 1875565: 2
2026-01-28 20:20:54 [ayvens.be] INFO: Extracting data for car ID: 1875565
2026-01-28 20:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff1373b-2b06-5786-a40a-c5dd8957e042 with identifier: 1875565
2026-01-28 20:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff1373b-2b06-5786-a40a-c5dd8957e042 with scrape type 2
2026-01-28 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff1373b-2b06-5786-a40a-c5dd8957e042 with scrape type 2
2026-01-28 20:20:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ff1373b-2b06-5786-a40a-c5dd8957e042, identifier: 1875565
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d66090>
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2bk%252Fdfd25a1b2e964626959fb4d90ab15177%252Fimages%252Flarge%252F20.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/20.jpg saved to cache
2026-01-28 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 979154bb-69ed-5919-a499-13d85b2a1c89
2026-01-28 20:20:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 979154bb-69ed-5919-a499-13d85b2a1c89, skipping ID generation
2026-01-28 20:20:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979154bb-69ed-5919-a499-13d85b2a1c89 with scrape type 1
2026-01-28 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 979154bb-69ed-5919-a499-13d85b2a1c89 from tracking dictionaries
2026-01-28 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 979154bb-69ed-5919-a499-13d85b2a1c89 sending to next pipeline
2026-01-28 20:20:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 979154bb-69ed-5919-a499-13d85b2a1c89, identifier: 1878663
2026-01-28 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/13.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ff1373b-2b06-5786-a40a-c5dd8957e042 with identifier: 1875565
2026-01-28 20:20:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ff1373b-2b06-5786-a40a-c5dd8957e042 with identifier: 1875565
2026-01-28 20:20:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ff1373b-2b06-5786-a40a-c5dd8957e042 with identifier: 1875565 to the API
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5ff1373b-2b06-5786-a40a-c5dd8957e042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5Aircross',
 'odometer': 93017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5Aircross 1.5 BLUEHDI 130 BUSINESS LOUNGE AUTO 105',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 BUSINESS LOUNGE AUTO 105',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875565%27 HTTP/1.1" 200 None
2026-01-28 20:20:55 [ayvens.be] INFO: Saving data for 1875565: {'auction_closing_time': 1770021000.0, 'created_time': 1769544769.161765, 'last_price_update_time': 1769631655.764565}
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875565') HTTP/1.1" 204 0
2026-01-28 20:20:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 979154bb-69ed-5919-a499-13d85b2a1c89 with identifier: 1878663
2026-01-28 20:20:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 979154bb-69ed-5919-a499-13d85b2a1c89 with identifier: 1878663
2026-01-28 20:20:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146336 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146336
2026-01-28 20:20:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 979154bb-69ed-5919-a499-13d85b2a1c89 spider: ayvens.be
2026-01-28 20:20:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 979154bb-69ed-5919-a499-13d85b2a1c89 due to rule: high_mileage_for_country.json, error: 146336 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146336
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': '979154bb-69ed-5919-a499-13d85b2a1c89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX3',
 'odometer': 146336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568346,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 556935,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 648694,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623771,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577405,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691437,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 741074,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 698585,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621814,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623661,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 730559,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605317,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 625333,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 546422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_979154bb-69ed-5919-a499-13d85b2a1c89/979154bb-69ed-5919-a499-13d85b2a1c89_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512965,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2bk/dfd25a1b2e964626959fb4d90ab15177/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX3 80KWH AUTO',
 'transmission': 'automatic',
 'trim': '80KWH AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878663%27 HTTP/1.1" 200 None
2026-01-28 20:20:55 [ayvens.be] INFO: Saving data for 1878663: {'created_time': 1769631655.977385, 'last_price_update_time': 1769631655.977397, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878663') HTTP/1.1" 204 0
2026-01-28 20:20:55 [ayvens.be] INFO: Found listing with ID: 1875566
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875566%27 HTTP/1.1" 200 None
2026-01-28 20:20:56 [ayvens.be] INFO: Scrape type for 1875566: 2
2026-01-28 20:20:56 [ayvens.be] INFO: Extracting data for car ID: 1875566
2026-01-28 20:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612d589a-3ebd-5da3-b23f-e5312967518c with identifier: 1875566
2026-01-28 20:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612d589a-3ebd-5da3-b23f-e5312967518c with scrape type 2
2026-01-28 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612d589a-3ebd-5da3-b23f-e5312967518c with scrape type 2
2026-01-28 20:20:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 612d589a-3ebd-5da3-b23f-e5312967518c, identifier: 1875566
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9bed0>
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/9.jpg saved to cache
2026-01-28 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 612d589a-3ebd-5da3-b23f-e5312967518c with identifier: 1875566
2026-01-28 20:20:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 612d589a-3ebd-5da3-b23f-e5312967518c with identifier: 1875566
2026-01-28 20:20:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 612d589a-3ebd-5da3-b23f-e5312967518c with identifier: 1875566 to the API
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '612d589a-3ebd-5da3-b23f-e5312967518c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLASS A (W177)',
 'odometer': 55164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLASS A (W177) A 160 Business Solution',
 'transmission': 'manual',
 'trim': 'A 160 Business Solution',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875566%27 HTTP/1.1" 200 None
2026-01-28 20:20:56 [ayvens.be] INFO: Saving data for 1875566: {'auction_closing_time': 1770021000.0, 'created_time': 1769544768.758907, 'last_price_update_time': 1769631656.697193}
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875566') HTTP/1.1" 204 0
2026-01-28 20:20:56 [ayvens.be] INFO: Found listing with ID: 1875567
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875567%27 HTTP/1.1" 200 None
2026-01-28 20:20:56 [ayvens.be] INFO: Scrape type for 1875567: 2
2026-01-28 20:20:56 [ayvens.be] INFO: Extracting data for car ID: 1875567
2026-01-28 20:20:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 412f5381-7f35-5b03-b2c3-7722b232ecc2 with identifier: 1875567
2026-01-28 20:20:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 412f5381-7f35-5b03-b2c3-7722b232ecc2 with scrape type 2
2026-01-28 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 412f5381-7f35-5b03-b2c3-7722b232ecc2 with scrape type 2
2026-01-28 20:20:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 412f5381-7f35-5b03-b2c3-7722b232ecc2, identifier: 1875567
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad1f40910>
2026-01-28 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:20:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2ar%252F077576f7df9946f3a16860beff85831b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/8.jpg saved to cache
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8504048-136a-5433-a5b0-10abf1ecd586
2026-01-28 20:20:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8504048-136a-5433-a5b0-10abf1ecd586, skipping ID generation
2026-01-28 20:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8504048-136a-5433-a5b0-10abf1ecd586 with scrape type 1
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8504048-136a-5433-a5b0-10abf1ecd586 from tracking dictionaries
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8504048-136a-5433-a5b0-10abf1ecd586 sending to next pipeline
2026-01-28 20:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f8504048-136a-5433-a5b0-10abf1ecd586, identifier: 1878665
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d0d310>
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F13.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/13.jpg saved to cache
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 412f5381-7f35-5b03-b2c3-7722b232ecc2 with identifier: 1875567
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 412f5381-7f35-5b03-b2c3-7722b232ecc2 with identifier: 1875567
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 127463 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    127463
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 412f5381-7f35-5b03-b2c3-7722b232ecc2 spider: ayvens.be
2026-01-28 20:20:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 412f5381-7f35-5b03-b2c3-7722b232ecc2 due to rule: high_mileage_for_country.json, error: 127463 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    127463
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '412f5381-7f35-5b03-b2c3-7722b232ecc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 127463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 SPORTBACK 2.0 30 TDI 85KW S TRONIC ATTRACTION B.E.',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 85KW S TRONIC ATTRACTION B.E.',
 'vin': None,
 'year': 2022}
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875567%27 HTTP/1.1" 200 None
2026-01-28 20:20:57 [ayvens.be] INFO: Saving data for 1875567: {'auction_closing_time': 1770021000.0, 'created_time': 1769544766.793316, 'last_price_update_time': 1769631657.696529}
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875567') HTTP/1.1" 204 0
2026-01-28 20:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f8504048-136a-5433-a5b0-10abf1ecd586 with identifier: 1878665
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f8504048-136a-5433-a5b0-10abf1ecd586 with identifier: 1878665
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149379 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149379
2026-01-28 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f8504048-136a-5433-a5b0-10abf1ecd586 spider: ayvens.be
2026-01-28 20:20:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: f8504048-136a-5433-a5b0-10abf1ecd586 due to rule: high_mileage_for_country.json, error: 149379 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149379
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f8504048-136a-5433-a5b0-10abf1ecd586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 149379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721185,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 709994,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 710950,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 737726,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 694412,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 688477,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601063,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 871887,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 912224,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663756,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636977,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 778436,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 670910,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 606116,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693811,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 713558,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668280,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 684921,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 659955,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8504048-136a-5433-a5b0-10abf1ecd586/f8504048-136a-5433-a5b0-10abf1ecd586_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635789,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2ar/077576f7df9946f3a16860beff85831b/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 GEARTRONIC INSCRIPTION',
 'transmission': 'automatic',
 'trim': '1.5 T2 GEARTRONIC INSCRIPTION',
 'vin': None,
 'year': 2021}
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878665%27 HTTP/1.1" 200 None
2026-01-28 20:20:57 [ayvens.be] INFO: Saving data for 1878665: {'created_time': 1769631657.950241, 'last_price_update_time': 1769631657.950255, 'auction_closing_time': 1770107400.0}
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878665') HTTP/1.1" 204 0
2026-01-28 20:20:57 [ayvens.be] INFO: Found listing with ID: 1875568
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875568%27 HTTP/1.1" 200 None
2026-01-28 20:20:57 [ayvens.be] INFO: Scrape type for 1875568: 2
2026-01-28 20:20:57 [ayvens.be] INFO: Extracting data for car ID: 1875568
2026-01-28 20:20:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with identifier: 1875568
2026-01-28 20:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with scrape type 2
2026-01-28 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with scrape type 2
2026-01-28 20:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd, identifier: 1875568
2026-01-28 20:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with identifier: 1875568
2026-01-28 20:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with identifier: 1875568
2026-01-28 20:20:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd with identifier: 1875568 to the API
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ab43b63f-cb0f-52ea-aec1-09bf9bd9e4bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 117879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI STYLE',
 'transmission': 'manual',
 'trim': '1.0 TSI STYLE',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875568%27 HTTP/1.1" 200 None
2026-01-28 20:20:58 [ayvens.be] INFO: Saving data for 1875568: {'auction_closing_time': 1770021000.0, 'created_time': 1769544763.071133, 'last_price_update_time': 1769631658.491952}
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875568') HTTP/1.1" 204 0
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2fe7610>
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/10.jpg saved to cache
2026-01-28 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:20:58 [ayvens.be] INFO: Found listing with ID: 1875569
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875569%27 HTTP/1.1" 200 None
2026-01-28 20:20:58 [ayvens.be] INFO: Scrape type for 1875569: 2
2026-01-28 20:20:58 [ayvens.be] INFO: Extracting data for car ID: 1875569
2026-01-28 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28fd93e5-c10e-50dd-963e-906879b62fe7 with identifier: 1875569
2026-01-28 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28fd93e5-c10e-50dd-963e-906879b62fe7 with scrape type 2
2026-01-28 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28fd93e5-c10e-50dd-963e-906879b62fe7 with scrape type 2
2026-01-28 20:20:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 28fd93e5-c10e-50dd-963e-906879b62fe7, identifier: 1875569
2026-01-28 20:20:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 28fd93e5-c10e-50dd-963e-906879b62fe7 with identifier: 1875569
2026-01-28 20:20:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 28fd93e5-c10e-50dd-963e-906879b62fe7 with identifier: 1875569
2026-01-28 20:20:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 28fd93e5-c10e-50dd-963e-906879b62fe7 with identifier: 1875569 to the API
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:20:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '28fd93e5-c10e-50dd-963e-906879b62fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 100983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE 1.3 CLA 250 E BUSINESS SOLUTION '
          'DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2020}
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875569%27 HTTP/1.1" 200 None
2026-01-28 20:20:59 [ayvens.be] INFO: Saving data for 1875569: {'auction_closing_time': 1770021000.0, 'created_time': 1769544762.702995, 'last_price_update_time': 1769631659.217189}
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875569') HTTP/1.1" 204 0
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff9ad0>
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/12.jpg saved to cache
2026-01-28 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9a010>
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/11.jpg saved to cache
2026-01-28 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ff8450>
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/2.jpg saved to cache
2026-01-28 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:21:00 [ayvens.be] INFO: Found listing with ID: 1875570
2026-01-28 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875570%27 HTTP/1.1" 200 None
2026-01-28 20:21:00 [ayvens.be] INFO: Scrape type for 1875570: 2
2026-01-28 20:21:00 [ayvens.be] INFO: Extracting data for car ID: 1875570
2026-01-28 20:21:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b543db93-c9be-5d96-8bad-a7caecd27d15 with identifier: 1875570
2026-01-28 20:21:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b543db93-c9be-5d96-8bad-a7caecd27d15 with scrape type 2
2026-01-28 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b543db93-c9be-5d96-8bad-a7caecd27d15 with scrape type 2
2026-01-28 20:21:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b543db93-c9be-5d96-8bad-a7caecd27d15, identifier: 1875570
2026-01-28 20:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b543db93-c9be-5d96-8bad-a7caecd27d15 with identifier: 1875570
2026-01-28 20:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b543db93-c9be-5d96-8bad-a7caecd27d15 with identifier: 1875570
2026-01-28 20:21:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b543db93-c9be-5d96-8bad-a7caecd27d15 with identifier: 1875570 to the API
2026-01-28 20:21:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b543db93-c9be-5d96-8bad-a7caecd27d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 86555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.2 PureTech Shine S&S',
 'transmission': 'manual',
 'trim': '1.2 PureTech Shine S&S',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875570%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Saving data for 1875570: {'auction_closing_time': 1770021000.0, 'created_time': 1769544578.768846, 'last_price_update_time': 1769631661.148001}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875570') HTTP/1.1" 204 0
2026-01-28 20:21:01 [ayvens.be] INFO: Found listing with ID: 1875571
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875571%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Scrape type for 1875571: 2
2026-01-28 20:21:01 [ayvens.be] INFO: Extracting data for car ID: 1875571
2026-01-28 20:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fc8b65-f7bb-5205-8bef-fe75f115ac97 with identifier: 1875571
2026-01-28 20:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fc8b65-f7bb-5205-8bef-fe75f115ac97 with scrape type 2
2026-01-28 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fc8b65-f7bb-5205-8bef-fe75f115ac97 with scrape type 2
2026-01-28 20:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 43fc8b65-f7bb-5205-8bef-fe75f115ac97, identifier: 1875571
2026-01-28 20:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 43fc8b65-f7bb-5205-8bef-fe75f115ac97 with identifier: 1875571
2026-01-28 20:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 43fc8b65-f7bb-5205-8bef-fe75f115ac97 with identifier: 1875571
2026-01-28 20:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139563 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    139563
2026-01-28 20:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 43fc8b65-f7bb-5205-8bef-fe75f115ac97 spider: ayvens.be
2026-01-28 20:21:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 43fc8b65-f7bb-5205-8bef-fe75f115ac97 due to rule: high_mileage_for_country.json, error: 139563 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    139563
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '43fc8b65-f7bb-5205-8bef-fe75f115ac97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 HATCH DIESEL - 2019',
 'odometer': 139563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 HATCH DIESEL - 2019 116 dA AdBlue',
 'transmission': 'automatic',
 'trim': '116 dA AdBlue',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875571%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Saving data for 1875571: {'auction_closing_time': 1770021000.0, 'created_time': 1769544573.127641, 'last_price_update_time': 1769631661.493162}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875571') HTTP/1.1" 204 0
2026-01-28 20:21:01 [ayvens.be] INFO: Found listing with ID: 1875572
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875572%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Scrape type for 1875572: 2
2026-01-28 20:21:01 [ayvens.be] INFO: Extracting data for car ID: 1875572
2026-01-28 20:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c78ff7-69a8-577b-b885-3122b92233bc with identifier: 1875572
2026-01-28 20:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c78ff7-69a8-577b-b885-3122b92233bc with scrape type 2
2026-01-28 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c78ff7-69a8-577b-b885-3122b92233bc with scrape type 2
2026-01-28 20:21:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 41c78ff7-69a8-577b-b885-3122b92233bc, identifier: 1875572
2026-01-28 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/12.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 41c78ff7-69a8-577b-b885-3122b92233bc with identifier: 1875572
2026-01-28 20:21:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 41c78ff7-69a8-577b-b885-3122b92233bc with identifier: 1875572
2026-01-28 20:21:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 41c78ff7-69a8-577b-b885-3122b92233bc with identifier: 1875572 to the API
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '41c78ff7-69a8-577b-b885-3122b92233bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 80241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875572%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Saving data for 1875572: {'auction_closing_time': 1770021000.0, 'created_time': 1769544568.330036, 'last_price_update_time': 1769631661.907727}
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875572') HTTP/1.1" 204 0
2026-01-28 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/9.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:01 [ayvens.be] INFO: Found listing with ID: 1875573
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875573%27 HTTP/1.1" 200 None
2026-01-28 20:21:01 [ayvens.be] INFO: Scrape type for 1875573: 2
2026-01-28 20:21:01 [ayvens.be] INFO: Extracting data for car ID: 1875573
2026-01-28 20:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b056b406-b3d1-5d87-8a9a-840c9fb8720b with identifier: 1875573
2026-01-28 20:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b056b406-b3d1-5d87-8a9a-840c9fb8720b with scrape type 2
2026-01-28 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b056b406-b3d1-5d87-8a9a-840c9fb8720b with scrape type 2
2026-01-28 20:21:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b056b406-b3d1-5d87-8a9a-840c9fb8720b, identifier: 1875573
2026-01-28 20:21:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b056b406-b3d1-5d87-8a9a-840c9fb8720b with identifier: 1875573
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b056b406-b3d1-5d87-8a9a-840c9fb8720b with identifier: 1875573
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171906 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    171906
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b056b406-b3d1-5d87-8a9a-840c9fb8720b spider: ayvens.be
2026-01-28 20:21:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b056b406-b3d1-5d87-8a9a-840c9fb8720b due to rule: high_mileage_for_country.json, error: 171906 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    171906
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b056b406-b3d1-5d87-8a9a-840c9fb8720b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 171906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 330E (135KW) BERLINE',
 'transmission': 'automatic',
 'trim': '2.0 330E (135KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875573%27 HTTP/1.1" 200 None
2026-01-28 20:21:02 [ayvens.be] INFO: Saving data for 1875573: {'auction_closing_time': 1770021000.0, 'created_time': 1769544566.243551, 'last_price_update_time': 1769631662.236067}
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875573') HTTP/1.1" 204 0
2026-01-28 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:02 [ayvens.be] INFO: Found listing with ID: 1875574
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875574%27 HTTP/1.1" 200 None
2026-01-28 20:21:02 [ayvens.be] INFO: Scrape type for 1875574: 2
2026-01-28 20:21:02 [ayvens.be] INFO: Extracting data for car ID: 1875574
2026-01-28 20:21:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b28b7f2e-3aad-5533-9449-7fd93cda417d with identifier: 1875574
2026-01-28 20:21:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b28b7f2e-3aad-5533-9449-7fd93cda417d with scrape type 2
2026-01-28 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b28b7f2e-3aad-5533-9449-7fd93cda417d with scrape type 2
2026-01-28 20:21:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b28b7f2e-3aad-5533-9449-7fd93cda417d, identifier: 1875574
2026-01-28 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b28b7f2e-3aad-5533-9449-7fd93cda417d with identifier: 1875574
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b28b7f2e-3aad-5533-9449-7fd93cda417d with identifier: 1875574
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177025 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177025
2026-01-28 20:21:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b28b7f2e-3aad-5533-9449-7fd93cda417d spider: ayvens.be
2026-01-28 20:21:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b28b7f2e-3aad-5533-9449-7fd93cda417d due to rule: high_mileage_for_country.json, error: 177025 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    177025
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b28b7f2e-3aad-5533-9449-7fd93cda417d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 177025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 1.4 EHYBRID DSG R-LINE SHOOTING BRAKE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID DSG R-LINE SHOOTING BRAKE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875574%27 HTTP/1.1" 200 None
2026-01-28 20:21:02 [ayvens.be] INFO: Saving data for 1875574: {'auction_closing_time': 1770021000.0, 'created_time': 1769544563.025771, 'last_price_update_time': 1769631662.627342}
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875574') HTTP/1.1" 204 0
2026-01-28 20:21:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2ca6450>
2026-01-28 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F12.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/12.jpg saved to cache
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c59e50>
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F9.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/9.jpg saved to cache
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:21:03 [ayvens.be] INFO: Found listing with ID: 1875575
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875575%27 HTTP/1.1" 200 None
2026-01-28 20:21:03 [ayvens.be] INFO: Scrape type for 1875575: 2
2026-01-28 20:21:03 [ayvens.be] INFO: Extracting data for car ID: 1875575
2026-01-28 20:21:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ffbafae-4331-5a64-acb7-6e26dfc18483 with identifier: 1875575
2026-01-28 20:21:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ffbafae-4331-5a64-acb7-6e26dfc18483 with scrape type 2
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ffbafae-4331-5a64-acb7-6e26dfc18483 with scrape type 2
2026-01-28 20:21:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6ffbafae-4331-5a64-acb7-6e26dfc18483, identifier: 1875575
2026-01-28 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6ffbafae-4331-5a64-acb7-6e26dfc18483 with identifier: 1875575
2026-01-28 20:21:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6ffbafae-4331-5a64-acb7-6e26dfc18483 with identifier: 1875575
2026-01-28 20:21:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145478 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145478
2026-01-28 20:21:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6ffbafae-4331-5a64-acb7-6e26dfc18483 spider: ayvens.be
2026-01-28 20:21:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6ffbafae-4331-5a64-acb7-6e26dfc18483 due to rule: high_mileage_for_country.json, error: 145478 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145478
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6ffbafae-4331-5a64-acb7-6e26dfc18483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'KAROQ',
 'odometer': 145478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA KAROQ 1.5 TSI 110KW DSG7 SPORTLINE',
 'transmission': 'automatic',
 'trim': '1.5 TSI 110KW DSG7 SPORTLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875575%27 HTTP/1.1" 200 None
2026-01-28 20:21:03 [ayvens.be] INFO: Saving data for 1875575: {'auction_closing_time': 1770021000.0, 'created_time': 1769544557.090338, 'last_price_update_time': 1769631663.726878}
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875575') HTTP/1.1" 204 0
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad30e1e50>
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/8.jpg saved to cache
2026-01-28 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:21:03 [ayvens.be] INFO: Found listing with ID: 1875576
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875576%27 HTTP/1.1" 200 None
2026-01-28 20:21:04 [ayvens.be] INFO: Scrape type for 1875576: 2
2026-01-28 20:21:04 [ayvens.be] INFO: Extracting data for car ID: 1875576
2026-01-28 20:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4207cc1a-1479-534a-beba-fb11b829b654 with identifier: 1875576
2026-01-28 20:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4207cc1a-1479-534a-beba-fb11b829b654 with scrape type 2
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4207cc1a-1479-534a-beba-fb11b829b654 with scrape type 2
2026-01-28 20:21:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4207cc1a-1479-534a-beba-fb11b829b654, identifier: 1875576
2026-01-28 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4207cc1a-1479-534a-beba-fb11b829b654 with identifier: 1875576
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4207cc1a-1479-534a-beba-fb11b829b654 with identifier: 1875576
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4207cc1a-1479-534a-beba-fb11b829b654 spider: ayvens.be
2026-01-28 20:21:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4207cc1a-1479-534a-beba-fb11b829b654 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4207cc1a-1479-534a-beba-fb11b829b654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 143058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 105KW 314 L3 RWD 3.5T FUNCTIONAL',
 'transmission': 'manual',
 'trim': '2.1CDI 105KW 314 L3 RWD 3.5T FUNCTIONAL',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875576%27 HTTP/1.1" 200 None
2026-01-28 20:21:04 [ayvens.be] INFO: Saving data for 1875576: {'auction_closing_time': 1770021000.0, 'created_time': 1769544552.383344, 'last_price_update_time': 1769631664.31964}
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875576') HTTP/1.1" 204 0
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2e90f10>
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yu%252Fcb539f18d36440768291f73408dd9491%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/1.jpg saved to cache
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419
2026-01-28 20:21:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419, skipping ID generation
2026-01-28 20:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 with scrape type 1
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 from tracking dictionaries
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 sending to next pipeline
2026-01-28 20:21:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419, identifier: 1878662
2026-01-28 20:21:04 [ayvens.be] INFO: Found listing with ID: 1875577
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875577%27 HTTP/1.1" 200 None
2026-01-28 20:21:04 [ayvens.be] INFO: Scrape type for 1875577: 2
2026-01-28 20:21:04 [ayvens.be] INFO: Extracting data for car ID: 1875577
2026-01-28 20:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with identifier: 1875577
2026-01-28 20:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with scrape type 2
2026-01-28 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with scrape type 2
2026-01-28 20:21:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55db5502-6b6e-5c5d-a1c3-50047b8e7a46, identifier: 1875577
2026-01-28 20:21:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 with identifier: 1878662
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 with identifier: 1878662
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154946 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    154946
2026-01-28 20:21:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 spider: ayvens.be
2026-01-28 20:21:05 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419 due to rule: high_mileage_for_country.json, error: 154946 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    154946
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 ACTIVE TOURER - 2018',
 'odometer': 154946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 623478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681048,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 594156,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578086,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 641222,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 664451,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695542,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 569359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564179,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 751210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 757976,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 590879,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571568,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 716529,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509557,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407210,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419/8a0f0c5c-ccf1-526e-8d50-a2b8c99c0419_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436937,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yu/cb539f18d36440768291f73408dd9491/images/large/18.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 ACTIVE TOURER - 2018 225xeA PHEV iPerformance OPF',
 'transmission': 'automatic',
 'trim': '225xeA PHEV iPerformance OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878662%27 HTTP/1.1" 200 None
2026-01-28 20:21:05 [ayvens.be] INFO: Saving data for 1878662: {'created_time': 1769631665.060207, 'last_price_update_time': 1769631665.060217, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878662') HTTP/1.1" 204 0
2026-01-28 20:21:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with identifier: 1875577
2026-01-28 20:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with identifier: 1875577
2026-01-28 20:21:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 55db5502-6b6e-5c5d-a1c3-50047b8e7a46 with identifier: 1875577 to the API
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '55db5502-6b6e-5c5d-a1c3-50047b8e7a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'DACIA',
 'model': 'SANDERO',
 'odometer': 44148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DACIA SANDERO 1.0 TCE 90 COMFORT',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 COMFORT',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875577%27 HTTP/1.1" 200 None
2026-01-28 20:21:05 [ayvens.be] INFO: Saving data for 1875577: {'auction_closing_time': 1770021000.0, 'created_time': 1769544545.212519, 'last_price_update_time': 1769631665.346734}
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875577') HTTP/1.1" 204 0
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad31b1150>
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg saved to cache
2026-01-28 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:21:05 [ayvens.be] INFO: Found listing with ID: 1875578
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875578%27 HTTP/1.1" 200 None
2026-01-28 20:21:05 [ayvens.be] INFO: Scrape type for 1875578: 2
2026-01-28 20:21:05 [ayvens.be] INFO: Extracting data for car ID: 1875578
2026-01-28 20:21:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44a477cd-0ec4-573a-bcaf-c8807c804966 with identifier: 1875578
2026-01-28 20:21:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44a477cd-0ec4-573a-bcaf-c8807c804966 with scrape type 2
2026-01-28 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44a477cd-0ec4-573a-bcaf-c8807c804966 with scrape type 2
2026-01-28 20:21:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 44a477cd-0ec4-573a-bcaf-c8807c804966, identifier: 1875578
2026-01-28 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/10.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 44a477cd-0ec4-573a-bcaf-c8807c804966 with identifier: 1875578
2026-01-28 20:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 44a477cd-0ec4-573a-bcaf-c8807c804966 with identifier: 1875578
2026-01-28 20:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-28 20:21:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 44a477cd-0ec4-573a-bcaf-c8807c804966 spider: ayvens.be
2026-01-28 20:21:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 44a477cd-0ec4-573a-bcaf-c8807c804966 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.1L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '44a477cd-0ec4-573a-bcaf-c8807c804966',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER',
 'odometer': 157353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 2.1CDI 105KW 314 L3 RWD 3.5T FUNCTIONAL',
 'transmission': 'manual',
 'trim': '2.1CDI 105KW 314 L3 RWD 3.5T FUNCTIONAL',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875578%27 HTTP/1.1" 200 None
2026-01-28 20:21:06 [ayvens.be] INFO: Saving data for 1875578: {'auction_closing_time': 1770021000.0, 'created_time': 1769544491.545714, 'last_price_update_time': 1769631666.057825}
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875578') HTTP/1.1" 204 0
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0df45d0>
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1wl%252Fbb87c9e05a2b4b6e94557cc835b7d50a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg saved to cache
2026-01-28 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a
2026-01-28 20:21:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30ae0324-9535-5ca2-9247-d41b3f25ec2a, skipping ID generation
2026-01-28 20:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a with scrape type 1
2026-01-28 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30ae0324-9535-5ca2-9247-d41b3f25ec2a from tracking dictionaries
2026-01-28 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30ae0324-9535-5ca2-9247-d41b3f25ec2a sending to next pipeline
2026-01-28 20:21:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 30ae0324-9535-5ca2-9247-d41b3f25ec2a, identifier: 1878661
2026-01-28 20:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/11.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:06 [ayvens.be] INFO: Found listing with ID: 1875579
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875579%27 HTTP/1.1" 200 None
2026-01-28 20:21:06 [ayvens.be] INFO: Scrape type for 1875579: 2
2026-01-28 20:21:06 [ayvens.be] INFO: Extracting data for car ID: 1875579
2026-01-28 20:21:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956b5c2e-7587-588e-b4fc-360acf099302 with identifier: 1875579
2026-01-28 20:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956b5c2e-7587-588e-b4fc-360acf099302 with scrape type 2
2026-01-28 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956b5c2e-7587-588e-b4fc-360acf099302 with scrape type 2
2026-01-28 20:21:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 956b5c2e-7587-588e-b4fc-360acf099302, identifier: 1875579
2026-01-28 20:21:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 30ae0324-9535-5ca2-9247-d41b3f25ec2a with identifier: 1878661
2026-01-28 20:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 30ae0324-9535-5ca2-9247-d41b3f25ec2a with identifier: 1878661
2026-01-28 20:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a4 avant', 'trim': '2.0 35 tfsi 110kw s tronic', 'title': 'audi a4 avant 2.0 35 tfsi 110kw s tronic', 'price': 0, 'odometer': 224842, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-01', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '30ae0324-9535-5ca2-9247-d41b3f25ec2a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644906}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 673298}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 650787}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 736188}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 593154}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 717122}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 746193}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 541047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 568465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 645478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 676452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 621952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 539689}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 605173}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 663064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 545736}], 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'audi a4 avant', 'sanitized_make': 'audi', 'odometer_in_km': 224842}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'petrol',
     'id': '30ae0324-9535-5ca2-9247-d41b3f25ec2a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a4 avant',
     'model': 'a4 avant',
     'odometer': 224842,
     'odometer_in_km': 224842,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644906,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683846,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644285,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 673298,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 650787,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 736188,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 593154,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 717122,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 746193,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 541047,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 568465,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 645478,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 676452,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 621952,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 539689,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 605173,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583613,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624555,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 663064,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 545736,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-07-01',
     'sanitized_make': 'audi',
     'seats_number': 5,
     'seller_name': None,
     'title': 'audi a4 avant 2.0 35 tfsi 110kw s tronic',
     'transmission': 'automatic',
     'trim': '2.0 35 tfsi 110kw s tronic',
     'vin': None,
     'year': 2019}
2026-01-28 20:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 30ae0324-9535-5ca2-9247-d41b3f25ec2a spider: ayvens.be
2026-01-28 20:21:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 30ae0324-9535-5ca2-9247-d41b3f25ec2a due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 20, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a4 avant', 'trim': '2.0 35 tfsi 110kw s tronic', 'title': 'audi a4 avant 2.0 35 tfsi 110kw s tronic', 'price': 0, 'odometer': 224842, 'odometer_reading_unit': 'km', 'registration_date': '2019-07-01', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171', 'expiration_date': '2026-02-03t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '30ae0324-9535-5ca2-9247-d41b3f25ec2a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644906}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 683846}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 644285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 673298}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 650787}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 736188}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 593154}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 717122}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 746193}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 541047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 568465}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 645478}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 676452}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 621952}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 539689}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 605173}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 583613}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 624555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 663064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 545736}], 'current_year_diff': 7, 'age_in_months': 78, 'make_model': 'audi a4 avant', 'sanitized_make': 'audi', 'odometer_in_km': 224842}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-03t08:30:00z',
     'fuel_type': 'petrol',
     'id': '30ae0324-9535-5ca2-9247-d41b3f25ec2a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a4 avant',
     'model': 'a4 avant',
     'odometer': 224842,
     'odometer_in_km': 224842,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 20,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644906,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 683846,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 644285,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 673298,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 650787,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 736188,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 593154,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 717122,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 746193,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 541047,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 568465,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 645478,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 676452,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 621952,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 539689,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 605173,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 583613,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 624555,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 663064,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg',
                 'Width': 1024},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 545736,
                 'Height': 768,
                 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg',
                 'Width': 1024}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-07-01',
     'sanitized_make': 'audi',
     'seats_number': 5,
     'seller_name': None,
     'title': 'audi a4 avant 2.0 35 tfsi 110kw s tronic',
     'transmission': 'automatic',
     'trim': '2.0 35 tfsi 110kw s tronic',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '30ae0324-9535-5ca2-9247-d41b3f25ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 224842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644906,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683846,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 644285,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 673298,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 650787,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 736188,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593154,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717122,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 746193,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541047,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568465,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 645478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 676452,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621952,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 539689,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605173,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583613,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 624555,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663064,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30ae0324-9535-5ca2-9247-d41b3f25ec2a/30ae0324-9535-5ca2-9247-d41b3f25ec2a_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 545736,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1wl/bb87c9e05a2b4b6e94557cc835b7d50a/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 35 TFSI 110KW S TRONIC',
 'transmission': 'automatic',
 'trim': '2.0 35 TFSI 110KW S TRONIC',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878661%27 HTTP/1.1" 200 None
2026-01-28 20:21:06 [ayvens.be] INFO: Saving data for 1878661: {'created_time': 1769631666.8548, 'last_price_update_time': 1769631666.85481, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878661') HTTP/1.1" 204 0
2026-01-28 20:21:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 956b5c2e-7587-588e-b4fc-360acf099302 with identifier: 1875579
2026-01-28 20:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 956b5c2e-7587-588e-b4fc-360acf099302 with identifier: 1875579
2026-01-28 20:21:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 956b5c2e-7587-588e-b4fc-360acf099302 with identifier: 1875579 to the API
2026-01-28 20:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '956b5c2e-7587-588e-b4fc-360acf099302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 65350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116I (80KW)',
 'transmission': 'manual',
 'trim': '1.5 116I (80KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875579%27 HTTP/1.1" 200 None
2026-01-28 20:21:07 [ayvens.be] INFO: Saving data for 1875579: {'auction_closing_time': 1770021000.0, 'created_time': 1769544475.819186, 'last_price_update_time': 1769631667.164976}
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875579') HTTP/1.1" 204 0
2026-01-28 20:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:07 [ayvens.be] INFO: Found listing with ID: 1875580
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875580%27 HTTP/1.1" 200 None
2026-01-28 20:21:07 [ayvens.be] INFO: Scrape type for 1875580: 2
2026-01-28 20:21:07 [ayvens.be] INFO: Extracting data for car ID: 1875580
2026-01-28 20:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b49b0b6b-6144-5c82-bce8-8d92d9be4044 with identifier: 1875580
2026-01-28 20:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b49b0b6b-6144-5c82-bce8-8d92d9be4044 with scrape type 2
2026-01-28 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b49b0b6b-6144-5c82-bce8-8d92d9be4044 with scrape type 2
2026-01-28 20:21:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b49b0b6b-6144-5c82-bce8-8d92d9be4044, identifier: 1875580
2026-01-28 20:21:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b49b0b6b-6144-5c82-bce8-8d92d9be4044 with identifier: 1875580
2026-01-28 20:21:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b49b0b6b-6144-5c82-bce8-8d92d9be4044 with identifier: 1875580
2026-01-28 20:21:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b49b0b6b-6144-5c82-bce8-8d92d9be4044 with identifier: 1875580 to the API
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b49b0b6b-6144-5c82-bce8-8d92d9be4044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 66898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.5 35 TFSI S LINE',
 'transmission': 'manual',
 'trim': '1.5 35 TFSI S LINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875580%27 HTTP/1.1" 200 None
2026-01-28 20:21:07 [ayvens.be] INFO: Saving data for 1875580: {'auction_closing_time': 1770021000.0, 'created_time': 1769544488.498468, 'last_price_update_time': 1769631667.858579}
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875580') HTTP/1.1" 204 0
2026-01-28 20:21:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2b255d0>
2026-01-28 20:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2be%252F12d8fb1897344ee78da989c43782b57b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/8.jpg saved to cache
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3943db45-fc65-587a-b56f-be44ba36383a
2026-01-28 20:21:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3943db45-fc65-587a-b56f-be44ba36383a, skipping ID generation
2026-01-28 20:21:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3943db45-fc65-587a-b56f-be44ba36383a with scrape type 1
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3943db45-fc65-587a-b56f-be44ba36383a from tracking dictionaries
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3943db45-fc65-587a-b56f-be44ba36383a sending to next pipeline
2026-01-28 20:21:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3943db45-fc65-587a-b56f-be44ba36383a, identifier: 1878659
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de8850>
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F10.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/10.jpg saved to cache
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4f1d0>
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F1yq%252Ff45551636722405c902dddf0625c8c1e%252Fimages%252Flarge%252F11.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/11.jpg saved to cache
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 59fd6894-4a8b-5923-9667-777c5c208f96
2026-01-28 20:21:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59fd6894-4a8b-5923-9667-777c5c208f96, skipping ID generation
2026-01-28 20:21:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59fd6894-4a8b-5923-9667-777c5c208f96 with scrape type 1
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 59fd6894-4a8b-5923-9667-777c5c208f96 from tracking dictionaries
2026-01-28 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59fd6894-4a8b-5923-9667-777c5c208f96 sending to next pipeline
2026-01-28 20:21:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 59fd6894-4a8b-5923-9667-777c5c208f96, identifier: 1878660
2026-01-28 20:21:09 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at -1 pages/min), scraped 129 items (at 49 items/min)
2026-01-28 20:21:09 [ayvens.be] INFO: Found listing with ID: 1875581
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875581%27 HTTP/1.1" 200 None
2026-01-28 20:21:09 [ayvens.be] INFO: Scrape type for 1875581: 2
2026-01-28 20:21:09 [ayvens.be] INFO: Extracting data for car ID: 1875581
2026-01-28 20:21:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3fd7af3-b29f-5feb-b055-c8d182265f8e with identifier: 1875581
2026-01-28 20:21:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3fd7af3-b29f-5feb-b055-c8d182265f8e with scrape type 2
2026-01-28 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3fd7af3-b29f-5feb-b055-c8d182265f8e with scrape type 2
2026-01-28 20:21:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d3fd7af3-b29f-5feb-b055-c8d182265f8e, identifier: 1875581
2026-01-28 20:21:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3943db45-fc65-587a-b56f-be44ba36383a with identifier: 1878659
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3943db45-fc65-587a-b56f-be44ba36383a with identifier: 1878659
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132665 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132665
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3943db45-fc65-587a-b56f-be44ba36383a spider: ayvens.be
2026-01-28 20:21:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3943db45-fc65-587a-b56f-be44ba36383a due to rule: high_mileage_for_country.json, error: 132665 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    132665
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '3943db45-fc65-587a-b56f-be44ba36383a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 132665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 608428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576829,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 571142,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626031,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 582256,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 554888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631850,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 617855,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 567573,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560094,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522342,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629448,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 696991,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 601563,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 506898,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3943db45-fc65-587a-b56f-be44ba36383a/3943db45-fc65-587a-b56f-be44ba36383a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 480560,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2be/12d8fb1897344ee78da989c43782b57b/images/large/17.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A1 1.0 25 TFSI ATTRACTION',
 'transmission': 'manual',
 'trim': '1.0 25 TFSI ATTRACTION',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878659%27 HTTP/1.1" 200 None
2026-01-28 20:21:09 [ayvens.be] INFO: Saving data for 1878659: {'created_time': 1769631669.329344, 'last_price_update_time': 1769631669.329354, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878659') HTTP/1.1" 204 0
2026-01-28 20:21:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 59fd6894-4a8b-5923-9667-777c5c208f96 with identifier: 1878660
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 59fd6894-4a8b-5923-9667-777c5c208f96 with identifier: 1878660
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142825 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    142825
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 59fd6894-4a8b-5923-9667-777c5c208f96 spider: ayvens.be
2026-01-28 20:21:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 59fd6894-4a8b-5923-9667-777c5c208f96 due to rule: high_mileage_for_country.json, error: 142825 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    142825
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '59fd6894-4a8b-5923-9667-777c5c208f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 142825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 678479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 658909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586359,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 683633,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 560200,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577303,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585252,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671198,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478743,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561397,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 667690,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 692502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 632614,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 489774,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fd6894-4a8b-5923-9667-777c5c208f96/59fd6894-4a8b-5923-9667-777c5c208f96_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 493428,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/1yq/f45551636722405c902dddf0625c8c1e/images/large/16.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 RECHARGE GEARTRONIC INSCRIPTION',
 'transmission': 'automatic',
 'trim': '2.0 T6 RECHARGE GEARTRONIC INSCRIPTION',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878660%27 HTTP/1.1" 200 None
2026-01-28 20:21:09 [ayvens.be] INFO: Saving data for 1878660: {'created_time': 1769631669.555805, 'last_price_update_time': 1769631669.555815, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878660') HTTP/1.1" 204 0
2026-01-28 20:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d3fd7af3-b29f-5feb-b055-c8d182265f8e with identifier: 1875581
2026-01-28 20:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d3fd7af3-b29f-5feb-b055-c8d182265f8e with identifier: 1875581
2026-01-28 20:21:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d3fd7af3-b29f-5feb-b055-c8d182265f8e with identifier: 1875581 to the API
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd3fd7af3-b29f-5feb-b055-c8d182265f8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 67847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875581%27 HTTP/1.1" 200 None
2026-01-28 20:21:09 [ayvens.be] INFO: Saving data for 1875581: {'auction_closing_time': 1770021000.0, 'created_time': 1769544487.4937, 'last_price_update_time': 1769631669.85765}
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875581') HTTP/1.1" 204 0
2026-01-28 20:21:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e4df10>
2026-01-28 20:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/4.jpg saved to cache
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2f8fe10>
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cu%252F1e1029488c374e848a50219d8dd59b46%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/5.jpg saved to cache
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f26205d-272d-5f14-9b06-590472cbd54d
2026-01-28 20:21:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f26205d-272d-5f14-9b06-590472cbd54d, skipping ID generation
2026-01-28 20:21:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f26205d-272d-5f14-9b06-590472cbd54d with scrape type 1
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f26205d-272d-5f14-9b06-590472cbd54d from tracking dictionaries
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f26205d-272d-5f14-9b06-590472cbd54d sending to next pipeline
2026-01-28 20:21:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1f26205d-272d-5f14-9b06-590472cbd54d, identifier: 1878657
2026-01-28 20:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:10 [ayvens.be] INFO: Found listing with ID: 1875582
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875582%27 HTTP/1.1" 200 None
2026-01-28 20:21:10 [ayvens.be] INFO: Scrape type for 1875582: 2
2026-01-28 20:21:10 [ayvens.be] INFO: Extracting data for car ID: 1875582
2026-01-28 20:21:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with identifier: 1875582
2026-01-28 20:21:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with scrape type 2
2026-01-28 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with scrape type 2
2026-01-28 20:21:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fe28a89-bcaa-584b-9d1e-209d4d521c67, identifier: 1875582
2026-01-28 20:21:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1f26205d-272d-5f14-9b06-590472cbd54d with identifier: 1878657
2026-01-28 20:21:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1f26205d-272d-5f14-9b06-590472cbd54d with identifier: 1878657
2026-01-28 20:21:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1f26205d-272d-5f14-9b06-590472cbd54d with identifier: 1878657 to the API
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1f26205d-272d-5f14-9b06-590472cbd54d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 42619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576604,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541401,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589141,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 558145,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573416,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 675263,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653124,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 782002,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 704589,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589660,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 614429,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 544618,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503479,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 634038,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f26205d-272d-5f14-9b06-590472cbd54d/1f26205d-272d-5f14-9b06-590472cbd54d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 490753,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cu/1e1029488c374e848a50219d8dd59b46/images/large/15.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878657%27 HTTP/1.1" 200 None
2026-01-28 20:21:10 [ayvens.be] INFO: Saving data for 1878657: {'created_time': 1769631670.917515, 'last_price_update_time': 1769631670.917528, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878657') HTTP/1.1" 204 0
2026-01-28 20:21:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with identifier: 1875582
2026-01-28 20:21:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with identifier: 1875582
2026-01-28 20:21:11 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fe28a89-bcaa-584b-9d1e-209d4d521c67 with identifier: 1875582 to the API
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'RED MULTI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '8fe28a89-bcaa-584b-9d1e-209d4d521c67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 94787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875582%27 HTTP/1.1" 200 None
2026-01-28 20:21:11 [ayvens.be] INFO: Saving data for 1875582: {'auction_closing_time': 1770021000.0, 'created_time': 1769544499.184951, 'last_price_update_time': 1769631671.233311}
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875582') HTTP/1.1" 204 0
2026-01-28 20:21:11 [ayvens.be] INFO: Found listing with ID: 1875583
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875583%27 HTTP/1.1" 200 None
2026-01-28 20:21:11 [ayvens.be] INFO: Scrape type for 1875583: 2
2026-01-28 20:21:11 [ayvens.be] INFO: Extracting data for car ID: 1875583
2026-01-28 20:21:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2172e632-c862-5556-835d-3dc793308bf3 with identifier: 1875583
2026-01-28 20:21:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2172e632-c862-5556-835d-3dc793308bf3 with scrape type 2
2026-01-28 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2172e632-c862-5556-835d-3dc793308bf3 with scrape type 2
2026-01-28 20:21:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2172e632-c862-5556-835d-3dc793308bf3, identifier: 1875583
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0dc0f90>
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2an%252F80d186e31d844f8cb1a8733c8a3522bb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/8.jpg saved to cache
2026-01-28 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9137b85-7a35-58ec-8fe4-c8b708ae526a
2026-01-28 20:21:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9137b85-7a35-58ec-8fe4-c8b708ae526a, skipping ID generation
2026-01-28 20:21:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9137b85-7a35-58ec-8fe4-c8b708ae526a with scrape type 1
2026-01-28 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9137b85-7a35-58ec-8fe4-c8b708ae526a from tracking dictionaries
2026-01-28 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9137b85-7a35-58ec-8fe4-c8b708ae526a sending to next pipeline
2026-01-28 20:21:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e9137b85-7a35-58ec-8fe4-c8b708ae526a, identifier: 1878658
2026-01-28 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/19.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2172e632-c862-5556-835d-3dc793308bf3 with identifier: 1875583
2026-01-28 20:21:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2172e632-c862-5556-835d-3dc793308bf3 with identifier: 1875583
2026-01-28 20:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131915 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    131915
2026-01-28 20:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2172e632-c862-5556-835d-3dc793308bf3 spider: ayvens.be
2026-01-28 20:21:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2172e632-c862-5556-835d-3dc793308bf3 due to rule: high_mileage_for_country.json, error: 131915 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    131915
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'CARBONSCHWARZ',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2172e632-c862-5556-835d-3dc793308bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X5',
 'odometer': 131915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0 XDRIVE45E 155KW 4WD AUTO',
 'transmission': 'automatic',
 'trim': '3.0 XDRIVE45E 155KW 4WD AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875583%27 HTTP/1.1" 200 None
2026-01-28 20:21:11 [ayvens.be] INFO: Saving data for 1875583: {'auction_closing_time': 1770021000.0, 'created_time': 1769544525.403225, 'last_price_update_time': 1769631671.976425}
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875583') HTTP/1.1" 204 0
2026-01-28 20:21:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e9137b85-7a35-58ec-8fe4-c8b708ae526a with identifier: 1878658
2026-01-28 20:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e9137b85-7a35-58ec-8fe4-c8b708ae526a with identifier: 1878658
2026-01-28 20:21:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152096 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152096
2026-01-28 20:21:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e9137b85-7a35-58ec-8fe4-c8b708ae526a spider: ayvens.be
2026-01-28 20:21:12 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e9137b85-7a35-58ec-8fe4-c8b708ae526a due to rule: high_mileage_for_country.json, error: 152096 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152096
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e9137b85-7a35-58ec-8fe4-c8b708ae526a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 152096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509481,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 477891,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 522936,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527239,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475738,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 749376,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 785502,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 878093,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 867888,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 655727,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 761119,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593330,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 612679,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 626322,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 629574,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593068,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 578389,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 668632,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9137b85-7a35-58ec-8fe4-c8b708ae526a/e9137b85-7a35-58ec-8fe4-c8b708ae526a_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 486495,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2an/80d186e31d844f8cb1a8733c8a3522bb/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878658%27 HTTP/1.1" 200 None
2026-01-28 20:21:12 [ayvens.be] INFO: Saving data for 1878658: {'created_time': 1769631672.286064, 'last_price_update_time': 1769631672.286073, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878658') HTTP/1.1" 204 0
2026-01-28 20:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/18.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:12 [ayvens.be] INFO: Found listing with ID: 1875584
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875584%27 HTTP/1.1" 200 None
2026-01-28 20:21:12 [ayvens.be] INFO: Scrape type for 1875584: 2
2026-01-28 20:21:12 [ayvens.be] INFO: Extracting data for car ID: 1875584
2026-01-28 20:21:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 745dda35-dcc3-5e05-ae06-d993494dc83b with identifier: 1875584
2026-01-28 20:21:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745dda35-dcc3-5e05-ae06-d993494dc83b with scrape type 2
2026-01-28 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 745dda35-dcc3-5e05-ae06-d993494dc83b with scrape type 2
2026-01-28 20:21:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 745dda35-dcc3-5e05-ae06-d993494dc83b, identifier: 1875584
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14290>
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/18.jpg saved to cache
2026-01-28 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:21:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 745dda35-dcc3-5e05-ae06-d993494dc83b with identifier: 1875584
2026-01-28 20:21:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 745dda35-dcc3-5e05-ae06-d993494dc83b with identifier: 1875584
2026-01-28 20:21:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 745dda35-dcc3-5e05-ae06-d993494dc83b with identifier: 1875584 to the API
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'TANSANITBLAU',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '745dda35-dcc3-5e05-ae06-d993494dc83b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'I4',
 'odometer': 61720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW I4 BEV EDRIVE40 GRAN COUPE',
 'transmission': 'automatic',
 'trim': 'BEV EDRIVE40 GRAN COUPE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875584%27 HTTP/1.1" 200 None
2026-01-28 20:21:13 [ayvens.be] INFO: Saving data for 1875584: {'auction_closing_time': 1770021000.0, 'created_time': 1769544529.649563, 'last_price_update_time': 1769631673.023886}
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875584') HTTP/1.1" 204 0
2026-01-28 20:21:13 [ayvens.be] INFO: Found listing with ID: 1875585
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875585%27 HTTP/1.1" 200 None
2026-01-28 20:21:13 [ayvens.be] INFO: Scrape type for 1875585: 2
2026-01-28 20:21:13 [ayvens.be] INFO: Extracting data for car ID: 1875585
2026-01-28 20:21:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734cec22-6ea1-594a-b76b-2927bd4a00fd with identifier: 1875585
2026-01-28 20:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734cec22-6ea1-594a-b76b-2927bd4a00fd with scrape type 2
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 734cec22-6ea1-594a-b76b-2927bd4a00fd with scrape type 2
2026-01-28 20:21:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 734cec22-6ea1-594a-b76b-2927bd4a00fd, identifier: 1875585
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0e57250>
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2cm%252F0a44ca234dbf42bba9545c650695af84%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/1.jpg saved to cache
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f
2026-01-28 20:21:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f, skipping ID generation
2026-01-28 20:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with scrape type 1
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f from tracking dictionaries
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df4fabb0-c489-5f94-ac13-e6f2d6acbc4f sending to next pipeline
2026-01-28 20:21:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f, identifier: 1878656
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2cec910>
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F19.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/19.jpg saved to cache
2026-01-28 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/17.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 734cec22-6ea1-594a-b76b-2927bd4a00fd with identifier: 1875585
2026-01-28 20:21:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 734cec22-6ea1-594a-b76b-2927bd4a00fd with identifier: 1875585
2026-01-28 20:21:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 4717 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    4717
2026-01-28 20:21:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: LOW_MILEAGE_FOR_COUNTRY failed for item: 734cec22-6ea1-594a-b76b-2927bd4a00fd spider: ayvens.be
2026-01-28 20:21:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 734cec22-6ea1-594a-b76b-2927bd4a00fd due to rule: low_mileage_for_country.json, error: 4717 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    4717
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'SOLID WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '734cec22-6ea1-594a-b76b-2927bd4a00fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'MICRA - 2017',
 'odometer': 4717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN MICRA - 2017 0.9 IG-T Acenta STOCK',
 'transmission': 'manual',
 'trim': '0.9 IG-T Acenta STOCK',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875585%27 HTTP/1.1" 200 None
2026-01-28 20:21:14 [ayvens.be] INFO: Saving data for 1875585: {'auction_closing_time': 1770021000.0, 'created_time': 1769544529.244586, 'last_price_update_time': 1769631674.127769}
2026-01-28 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875585') HTTP/1.1" 204 0
2026-01-28 20:21:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with identifier: 1878656
2026-01-28 20:21:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with identifier: 1878656
2026-01-28 20:21:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df4fabb0-c489-5f94-ac13-e6f2d6acbc4f with identifier: 1878656 to the API
2026-01-28 20:21:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'df4fabb0-c489-5f94-ac13-e6f2d6acbc4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 20266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754027,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 686949,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 706665,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 721070,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654167,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 764175,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631551,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897194,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 903123,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 685395,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647447,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 671531,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621524,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627025,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 687478,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 657670,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 654371,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690827,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 583422,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/19.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df4fabb0-c489-5f94-ac13-e6f2d6acbc4f/df4fabb0-c489-5f94-ac13-e6f2d6acbc4f_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 663599,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2cm/0a44ca234dbf42bba9545c650695af84/images/large/20.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 150KW PRO PERFORMANCE',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 150KW PRO PERFORMANCE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878656%27 HTTP/1.1" 200 None
2026-01-28 20:21:15 [ayvens.be] INFO: Saving data for 1878656: {'created_time': 1769631675.613972, 'last_price_update_time': 1769631675.613982, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878656') HTTP/1.1" 204 0
2026-01-28 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/16.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/15.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:15 [ayvens.be] INFO: Found listing with ID: 1875586
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875586%27 HTTP/1.1" 200 None
2026-01-28 20:21:15 [ayvens.be] INFO: Scrape type for 1875586: 2
2026-01-28 20:21:15 [ayvens.be] INFO: Extracting data for car ID: 1875586
2026-01-28 20:21:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0000b5a8-db61-5826-94fa-88c2957ed10d with identifier: 1875586
2026-01-28 20:21:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0000b5a8-db61-5826-94fa-88c2957ed10d with scrape type 2
2026-01-28 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0000b5a8-db61-5826-94fa-88c2957ed10d with scrape type 2
2026-01-28 20:21:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0000b5a8-db61-5826-94fa-88c2957ed10d, identifier: 1875586
2026-01-28 20:21:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0000b5a8-db61-5826-94fa-88c2957ed10d with identifier: 1875586
2026-01-28 20:21:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0000b5a8-db61-5826-94fa-88c2957ed10d with identifier: 1875586
2026-01-28 20:21:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0000b5a8-db61-5826-94fa-88c2957ed10d with identifier: 1875586 to the API
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'PLATINIUM GREY',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '0000b5a8-db61-5826-94fa-88c2957ed10d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS7 CROSSBACK DIESEL',
 'odometer': 63672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS7 CROSSBACK DIESEL 1.5 BlueHDi Performance Line '
          '(EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Performance Line (EU6.2)',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875586%27 HTTP/1.1" 200 None
2026-01-28 20:21:16 [ayvens.be] INFO: Saving data for 1875586: {'auction_closing_time': 1770021000.0, 'created_time': 1769544521.75843, 'last_price_update_time': 1769631676.017607}
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875586') HTTP/1.1" 204 0
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0c68a50>
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F18.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/18.jpg saved to cache
2026-01-28 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/14.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:21:16 [ayvens.be] INFO: Found listing with ID: 1875587
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875587%27 HTTP/1.1" 200 None
2026-01-28 20:21:16 [ayvens.be] INFO: Scrape type for 1875587: 2
2026-01-28 20:21:16 [ayvens.be] INFO: Extracting data for car ID: 1875587
2026-01-28 20:21:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with identifier: 1875587
2026-01-28 20:21:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with scrape type 2
2026-01-28 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with scrape type 2
2026-01-28 20:21:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72, identifier: 1875587
2026-01-28 20:21:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with identifier: 1875587
2026-01-28 20:21:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with identifier: 1875587
2026-01-28 20:21:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72 with identifier: 1875587 to the API
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9b1e988e-2a1d-5cdf-9a70-2f7cfe2d1b72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008 DIESEL - 2016',
 'odometer': 76833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 DIESEL - 2016 1.5 BlueHDi Allure (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure (EU6.2)',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875587%27 HTTP/1.1" 200 None
2026-01-28 20:21:16 [ayvens.be] INFO: Saving data for 1875587: {'auction_closing_time': 1770021000.0, 'created_time': 1769544539.38944, 'last_price_update_time': 1769631676.739839}
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875587') HTTP/1.1" 204 0
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad0de7390>
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F17.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/17.jpg saved to cache
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d14a10>
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F16.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/16.jpg saved to cache
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2d4bc90>
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F15.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/15.jpg saved to cache
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:17 [ayvens.be] INFO: Found listing with ID: 1875588
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875588%27 HTTP/1.1" 200 None
2026-01-28 20:21:17 [ayvens.be] INFO: Scrape type for 1875588: 2
2026-01-28 20:21:17 [ayvens.be] INFO: Extracting data for car ID: 1875588
2026-01-28 20:21:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with identifier: 1875588
2026-01-28 20:21:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with scrape type 2
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with scrape type 2
2026-01-28 20:21:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9c7c83fe-58ed-5352-8e22-a9bd979174d0, identifier: 1875588
2026-01-28 20:21:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with identifier: 1875588
2026-01-28 20:21:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with identifier: 1875588
2026-01-28 20:21:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9c7c83fe-58ed-5352-8e22-a9bd979174d0 with identifier: 1875588 to the API
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '9c7c83fe-58ed-5352-8e22-a9bd979174d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'GALAXY DIESEL - 2015',
 'odometer': 68088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'FORD GALAXY DIESEL - 2015 2.0 TDCi Titanium AdBlue (EU6.2)',
 'transmission': 'automatic',
 'trim': '2.0 TDCi Titanium AdBlue (EU6.2)',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875588%27 HTTP/1.1" 200 None
2026-01-28 20:21:17 [ayvens.be] INFO: Saving data for 1875588: {'auction_closing_time': 1770021000.0, 'created_time': 1769544539.781934, 'last_price_update_time': 1769631677.897074}
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875588') HTTP/1.1" 204 0
2026-01-28 20:21:17 [ayvens.be] INFO: Found listing with ID: 1875589
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875589%27 HTTP/1.1" 200 None
2026-01-28 20:21:17 [ayvens.be] INFO: Scrape type for 1875589: 2
2026-01-28 20:21:17 [ayvens.be] INFO: Extracting data for car ID: 1875589
2026-01-28 20:21:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed with identifier: 1875589
2026-01-28 20:21:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed with scrape type 2
2026-01-28 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed with scrape type 2
2026-01-28 20:21:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed, identifier: 1875589
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbad2c9b8d0>
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.be',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252F2br%252F916ce9be4cf1455e962f8d914bc71a77%252Fimages%252Flarge%252F14.jpg') HTTP/1.1" 204 0
2026-01-28 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/14.jpg saved to cache
2026-01-28 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5
2026-01-28 20:21:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5, skipping ID generation
2026-01-28 20:21:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with scrape type 1
2026-01-28 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 from tracking dictionaries
2026-01-28 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 sending to next pipeline
2026-01-28 20:21:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5, identifier: 1878655
2026-01-28 20:21:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed with identifier: 1875589
2026-01-28 20:21:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed with identifier: 1875589
2026-01-28 20:21:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 141501 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    141501
2026-01-28 20:21:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed spider: ayvens.be
2026-01-28 20:21:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed due to rule: high_mileage_for_country.json, error: 141501 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    141501
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ef7ba1f5-9a82-507d-88c2-a5d12ca6c6ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 141501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 1.4 TSI PHEV 150KW DSG STYLE',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV 150KW DSG STYLE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875589%27 HTTP/1.1" 200 None
2026-01-28 20:21:18 [ayvens.be] INFO: Saving data for 1875589: {'auction_closing_time': 1770021000.0, 'created_time': 1769544540.049547, 'last_price_update_time': 1769631678.562572}
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875589') HTTP/1.1" 204 0
2026-01-28 20:21:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with identifier: 1878655
2026-01-28 20:21:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with identifier: 1878655
2026-01-28 20:21:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 06afe3fa-05c3-5b0f-ae11-b4720ebea6a5 with identifier: 1878655 to the API
2026-01-28 20:21:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'SOLID BLACK',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-03T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '06afe3fa-05c3-5b0f-ae11-b4720ebea6a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39171',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 20321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607037,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555078,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/2.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 616725,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/3.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 597663,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/4.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 588794,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/5.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 693882,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/6.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613691,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 712878,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/8.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 754974,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/9.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610014,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/10.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 615236,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/11.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 589909,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/12.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527323,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/13.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 585540,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/14.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553095,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/15.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551985,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/16.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 574737,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/17.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561867,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/18.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06afe3fa-05c3-5b0f-ae11-b4720ebea6a5/06afe3fa-05c3-5b0f-ae11-b4720ebea6a5_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 495255,
             'Height': 768,
             'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/2br/916ce9be4cf1455e962f8d914bc71a77/images/large/19.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM CORE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271878655%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Saving data for 1878655: {'created_time': 1769631680.095521, 'last_price_update_time': 1769631680.095532, 'auction_closing_time': 1770107400.0}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1878655') HTTP/1.1" 204 0
2026-01-28 20:21:20 [ayvens.be] INFO: Found listing with ID: 1875590
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875590%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Scrape type for 1875590: 2
2026-01-28 20:21:20 [ayvens.be] INFO: Extracting data for car ID: 1875590
2026-01-28 20:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with identifier: 1875590
2026-01-28 20:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with scrape type 2
2026-01-28 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with scrape type 2
2026-01-28 20:21:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b, identifier: 1875590
2026-01-28 20:21:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with identifier: 1875590
2026-01-28 20:21:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with identifier: 1875590
2026-01-28 20:21:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b with identifier: 1875590 to the API
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '3616c2d8-f99b-58e5-8e10-b9ae3c23ff1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'IX',
 'odometer': 10017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW IX BEV 77KWH XDRIVE40',
 'transmission': 'automatic',
 'trim': 'BEV 77KWH XDRIVE40',
 'vin': None,
 'year': 2023}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875590%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Saving data for 1875590: {'auction_closing_time': 1770021000.0, 'created_time': 1769544547.373304, 'last_price_update_time': 1769631680.496528}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875590') HTTP/1.1" 204 0
2026-01-28 20:21:20 [ayvens.be] INFO: Found listing with ID: 1875591
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875591%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Scrape type for 1875591: 2
2026-01-28 20:21:20 [ayvens.be] INFO: Extracting data for car ID: 1875591
2026-01-28 20:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce8de32-2127-59a5-b009-02f3bf3d2837 with identifier: 1875591
2026-01-28 20:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce8de32-2127-59a5-b009-02f3bf3d2837 with scrape type 2
2026-01-28 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce8de32-2127-59a5-b009-02f3bf3d2837 with scrape type 2
2026-01-28 20:21:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3ce8de32-2127-59a5-b009-02f3bf3d2837, identifier: 1875591
2026-01-28 20:21:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3ce8de32-2127-59a5-b009-02f3bf3d2837 with identifier: 1875591
2026-01-28 20:21:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3ce8de32-2127-59a5-b009-02f3bf3d2837 with identifier: 1875591
2026-01-28 20:21:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3ce8de32-2127-59a5-b009-02f3bf3d2837 with identifier: 1875591 to the API
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '3ce8de32-2127-59a5-b009-02f3bf3d2837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW DIESEL - 2017',
 'odometer': 103252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW DIESEL - 2017 1.5 BlueHDi Allure (EU6.3)',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure (EU6.3)',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875591%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Saving data for 1875591: {'auction_closing_time': 1770021000.0, 'created_time': 1769544554.680685, 'last_price_update_time': 1769631680.902908}
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875591') HTTP/1.1" 204 0
2026-01-28 20:21:20 [ayvens.be] INFO: Found listing with ID: 1875592
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875592%27 HTTP/1.1" 200 None
2026-01-28 20:21:20 [ayvens.be] INFO: Scrape type for 1875592: 2
2026-01-28 20:21:20 [ayvens.be] INFO: Extracting data for car ID: 1875592
2026-01-28 20:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724774b1-dd79-5024-9ef5-f8077ade279a with identifier: 1875592
2026-01-28 20:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724774b1-dd79-5024-9ef5-f8077ade279a with scrape type 2
2026-01-28 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 724774b1-dd79-5024-9ef5-f8077ade279a with scrape type 2
2026-01-28 20:21:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 724774b1-dd79-5024-9ef5-f8077ade279a, identifier: 1875592
2026-01-28 20:21:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 724774b1-dd79-5024-9ef5-f8077ade279a with identifier: 1875592
2026-01-28 20:21:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 724774b1-dd79-5024-9ef5-f8077ade279a with identifier: 1875592
2026-01-28 20:21:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 724774b1-dd79-5024-9ef5-f8077ade279a with identifier: 1875592 to the API
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '724774b1-dd79-5024-9ef5-f8077ade279a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5',
 'odometer': 99474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 2.0 TFSI E 50 220KW S TR QUAT. 4WD',
 'transmission': 'automatic',
 'trim': '2.0 TFSI E 50 220KW S TR QUAT. 4WD',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875592%27 HTTP/1.1" 200 None
2026-01-28 20:21:21 [ayvens.be] INFO: Saving data for 1875592: {'auction_closing_time': 1770021000.0, 'created_time': 1769544560.964475, 'last_price_update_time': 1769631681.351597}
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875592') HTTP/1.1" 204 0
2026-01-28 20:21:21 [ayvens.be] INFO: Found listing with ID: 1875593
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875593%27 HTTP/1.1" 200 None
2026-01-28 20:21:21 [ayvens.be] INFO: Scrape type for 1875593: 2
2026-01-28 20:21:21 [ayvens.be] INFO: Extracting data for car ID: 1875593
2026-01-28 20:21:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with identifier: 1875593
2026-01-28 20:21:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with scrape type 2
2026-01-28 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with scrape type 2
2026-01-28 20:21:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2199ffa6-efd3-5da0-90d3-8b6d7916b089, identifier: 1875593
2026-01-28 20:21:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with identifier: 1875593
2026-01-28 20:21:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with identifier: 1875593
2026-01-28 20:21:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2199ffa6-efd3-5da0-90d3-8b6d7916b089 with identifier: 1875593 to the API
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2199ffa6-efd3-5da0-90d3-8b6d7916b089',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2',
 'odometer': 97866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875593%27 HTTP/1.1" 200 None
2026-01-28 20:21:21 [ayvens.be] INFO: Saving data for 1875593: {'auction_closing_time': 1770021000.0, 'created_time': 1769544569.561234, 'last_price_update_time': 1769631681.737456}
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875593') HTTP/1.1" 204 0
2026-01-28 20:21:21 [ayvens.be] INFO: Found listing with ID: 1875594
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875594%27 HTTP/1.1" 200 None
2026-01-28 20:21:21 [ayvens.be] INFO: Scrape type for 1875594: 2
2026-01-28 20:21:21 [ayvens.be] INFO: Extracting data for car ID: 1875594
2026-01-28 20:21:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be4ebdbe-a624-515a-8154-34a84066fc47 with identifier: 1875594
2026-01-28 20:21:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be4ebdbe-a624-515a-8154-34a84066fc47 with scrape type 2
2026-01-28 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be4ebdbe-a624-515a-8154-34a84066fc47 with scrape type 2
2026-01-28 20:21:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: be4ebdbe-a624-515a-8154-34a84066fc47, identifier: 1875594
2026-01-28 20:21:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: be4ebdbe-a624-515a-8154-34a84066fc47 with identifier: 1875594
2026-01-28 20:21:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: be4ebdbe-a624-515a-8154-34a84066fc47 with identifier: 1875594
2026-01-28 20:21:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: be4ebdbe-a624-515a-8154-34a84066fc47 with identifier: 1875594 to the API
2026-01-28 20:21:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MIDNIGHT SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'be4ebdbe-a624-515a-8154-34a84066fc47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 67873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875594%27 HTTP/1.1" 200 None
2026-01-28 20:21:22 [ayvens.be] INFO: Saving data for 1875594: {'auction_closing_time': 1770021000.0, 'created_time': 1769544586.649907, 'last_price_update_time': 1769631682.153678}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875594') HTTP/1.1" 204 0
2026-01-28 20:21:22 [ayvens.be] INFO: Found listing with ID: 1875595
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875595%27 HTTP/1.1" 200 None
2026-01-28 20:21:22 [ayvens.be] INFO: Scrape type for 1875595: 2
2026-01-28 20:21:22 [ayvens.be] INFO: Extracting data for car ID: 1875595
2026-01-28 20:21:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 with identifier: 1875595
2026-01-28 20:21:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 with scrape type 2
2026-01-28 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 with scrape type 2
2026-01-28 20:21:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58, identifier: 1875595
2026-01-28 20:21:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 with identifier: 1875595
2026-01-28 20:21:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 with identifier: 1875595
2026-01-28 20:21:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'golf vii variant - 2017', 'trim': '1.0 tsi comfortline opf stock', 'title': 'volkswagen golf vii variant - 2017 1.0 tsi comfortline opf stock', 'price': 0, 'odometer': 205372, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-20', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120', 'expiration_date': '2026-02-02t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'd1a4673e-1cd5-5d1b-bb61-2f015f32ca58', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'volkswagen golf vii variant - 2017', 'sanitized_make': 'volkswagen', 'odometer_in_km': 205372}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.0l',
     'expiration_date': '2026-02-02t08:30:00z',
     'fuel_type': 'petrol',
     'id': 'd1a4673e-1cd5-5d1b-bb61-2f015f32ca58',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen golf vii variant - 2017',
     'model': 'golf vii variant - 2017',
     'odometer': 205372,
     'odometer_in_km': 205372,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-02-20',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen golf vii variant - 2017 1.0 tsi comfortline opf '
              'stock',
     'transmission': 'manual',
     'trim': '1.0 tsi comfortline opf stock',
     'vin': None,
     'year': 2020}
2026-01-28 20:21:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 spider: ayvens.be
2026-01-28 20:21:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d1a4673e-1cd5-5d1b-bb61-2f015f32ca58 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'volkswagen', 'model': 'golf vii variant - 2017', 'trim': '1.0 tsi comfortline opf stock', 'title': 'volkswagen golf vii variant - 2017 1.0 tsi comfortline opf stock', 'price': 0, 'odometer': 205372, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-20', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120', 'expiration_date': '2026-02-02t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'd1a4673e-1cd5-5d1b-bb61-2f015f32ca58', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'volkswagen golf vii variant - 2017', 'sanitized_make': 'volkswagen', 'odometer_in_km': 205372}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.0l',
     'expiration_date': '2026-02-02t08:30:00z',
     'fuel_type': 'petrol',
     'id': 'd1a4673e-1cd5-5d1b-bb61-2f015f32ca58',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
     'listing': 'auction',
     'location': None,
     'make': 'volkswagen',
     'make_model': 'volkswagen golf vii variant - 2017',
     'model': 'golf vii variant - 2017',
     'odometer': 205372,
     'odometer_in_km': 205372,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-02-20',
     'sanitized_make': 'volkswagen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'volkswagen golf vii variant - 2017 1.0 tsi comfortline opf '
              'stock',
     'transmission': 'manual',
     'trim': '1.0 tsi comfortline opf stock',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd1a4673e-1cd5-5d1b-bb61-2f015f32ca58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII VARIANT - 2017',
 'odometer': 205372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII VARIANT - 2017 1.0 TSI Comfortline OPF STOCK',
 'transmission': 'manual',
 'trim': '1.0 TSI Comfortline OPF STOCK',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875595%27 HTTP/1.1" 200 None
2026-01-28 20:21:22 [ayvens.be] INFO: Saving data for 1875595: {'auction_closing_time': 1770021000.0, 'created_time': 1769544584.52924, 'last_price_update_time': 1769631682.489894}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875595') HTTP/1.1" 204 0
2026-01-28 20:21:22 [ayvens.be] INFO: Found listing with ID: 1875596
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875596%27 HTTP/1.1" 200 None
2026-01-28 20:21:22 [ayvens.be] INFO: Scrape type for 1875596: 2
2026-01-28 20:21:22 [ayvens.be] INFO: Extracting data for car ID: 1875596
2026-01-28 20:21:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with identifier: 1875596
2026-01-28 20:21:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with scrape type 2
2026-01-28 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with scrape type 2
2026-01-28 20:21:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648, identifier: 1875596
2026-01-28 20:21:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with identifier: 1875596
2026-01-28 20:21:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with identifier: 1875596
2026-01-28 20:21:22 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2f2a1cb0-e5ea-5993-b10c-caa0e4e68648 with identifier: 1875596 to the API
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2f2a1cb0-e5ea-5993-b10c-caa0e4e68648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 123814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 1.4 TSI MSQ VARIANT GTE BUSINESS',
 'transmission': 'automatic',
 'trim': '1.4 TSI MSQ VARIANT GTE BUSINESS',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875596%27 HTTP/1.1" 200 None
2026-01-28 20:21:22 [ayvens.be] INFO: Saving data for 1875596: {'auction_closing_time': 1770021000.0, 'created_time': 1769544758.368627, 'last_price_update_time': 1769631682.889663}
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875596') HTTP/1.1" 204 0
2026-01-28 20:21:23 [ayvens.be] INFO: Found listing with ID: 1875597
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875597%27 HTTP/1.1" 200 None
2026-01-28 20:21:23 [ayvens.be] INFO: Scrape type for 1875597: 2
2026-01-28 20:21:23 [ayvens.be] INFO: Extracting data for car ID: 1875597
2026-01-28 20:21:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with identifier: 1875597
2026-01-28 20:21:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 229ec59a-a9c1-514a-bb3d-b3f99429a8aa, identifier: 1875597
2026-01-28 20:21:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with identifier: 1875597
2026-01-28 20:21:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with identifier: 1875597
2026-01-28 20:21:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 229ec59a-a9c1-514a-bb3d-b3f99429a8aa with identifier: 1875597 to the API
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '229ec59a-a9c1-514a-bb3d-b3f99429a8aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 66651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'transmission': 'manual',
 'trim': '1.3 A 180 BUSINESS SOLUTION ESSENTIAL',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875597%27 HTTP/1.1" 200 None
2026-01-28 20:21:23 [ayvens.be] INFO: Saving data for 1875597: {'auction_closing_time': 1770021000.0, 'created_time': 1769544666.098508, 'last_price_update_time': 1769631683.411403}
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875597') HTTP/1.1" 204 0
2026-01-28 20:21:23 [ayvens.be] INFO: Found listing with ID: 1875598
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875598%27 HTTP/1.1" 200 None
2026-01-28 20:21:23 [ayvens.be] INFO: Scrape type for 1875598: 2
2026-01-28 20:21:23 [ayvens.be] INFO: Extracting data for car ID: 1875598
2026-01-28 20:21:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63edf58e-d185-50f5-9554-301d733858a8 with identifier: 1875598
2026-01-28 20:21:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63edf58e-d185-50f5-9554-301d733858a8 with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63edf58e-d185-50f5-9554-301d733858a8 with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 63edf58e-d185-50f5-9554-301d733858a8, identifier: 1875598
2026-01-28 20:21:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 63edf58e-d185-50f5-9554-301d733858a8 with identifier: 1875598
2026-01-28 20:21:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 63edf58e-d185-50f5-9554-301d733858a8 with identifier: 1875598
2026-01-28 20:21:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 63edf58e-d185-50f5-9554-301d733858a8 with identifier: 1875598 to the API
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '63edf58e-d185-50f5-9554-301d733858a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 68151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 2008 1.2 PURETECH 74KW S-S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 74KW S-S ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875598%27 HTTP/1.1" 200 None
2026-01-28 20:21:23 [ayvens.be] INFO: Saving data for 1875598: {'auction_closing_time': 1770021000.0, 'created_time': 1769544605.273854, 'last_price_update_time': 1769631683.815792}
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875598') HTTP/1.1" 204 0
2026-01-28 20:21:23 [ayvens.be] INFO: Found listing with ID: 1875599
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875599%27 HTTP/1.1" 200 None
2026-01-28 20:21:23 [ayvens.be] INFO: Scrape type for 1875599: 2
2026-01-28 20:21:23 [ayvens.be] INFO: Extracting data for car ID: 1875599
2026-01-28 20:21:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac with identifier: 1875599
2026-01-28 20:21:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123eb6c5-94c4-50c7-8f0f-80f40f4831ac with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123eb6c5-94c4-50c7-8f0f-80f40f4831ac with scrape type 2
2026-01-28 20:21:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac, identifier: 1875599
2026-01-28 20:21:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac with identifier: 1875599
2026-01-28 20:21:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac with identifier: 1875599
2026-01-28 20:21:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152234 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152234
2026-01-28 20:21:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac spider: ayvens.be
2026-01-28 20:21:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 123eb6c5-94c4-50c7-8f0f-80f40f4831ac due to rule: high_mileage_for_country.json, error: 152234 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152234
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '123eb6c5-94c4-50c7-8f0f-80f40f4831ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'C5 AIRCROSS DIESEL',
 'odometer': 152234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N C5 AIRCROSS DIESEL 1.5 BlueHDi Shine S&S',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Shine S&S',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875599%27 HTTP/1.1" 200 None
2026-01-28 20:21:24 [ayvens.be] INFO: Saving data for 1875599: {'auction_closing_time': 1770021000.0, 'created_time': 1769544631.979178, 'last_price_update_time': 1769631684.143757}
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875599') HTTP/1.1" 204 0
2026-01-28 20:21:24 [ayvens.be] INFO: Found listing with ID: 1875600
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875600%27 HTTP/1.1" 200 None
2026-01-28 20:21:24 [ayvens.be] INFO: Scrape type for 1875600: 2
2026-01-28 20:21:24 [ayvens.be] INFO: Extracting data for car ID: 1875600
2026-01-28 20:21:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64bf1f2-1376-55ce-b313-cda67cd7925e with identifier: 1875600
2026-01-28 20:21:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64bf1f2-1376-55ce-b313-cda67cd7925e with scrape type 2
2026-01-28 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64bf1f2-1376-55ce-b313-cda67cd7925e with scrape type 2
2026-01-28 20:21:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e64bf1f2-1376-55ce-b313-cda67cd7925e, identifier: 1875600
2026-01-28 20:21:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e64bf1f2-1376-55ce-b313-cda67cd7925e with identifier: 1875600
2026-01-28 20:21:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e64bf1f2-1376-55ce-b313-cda67cd7925e with identifier: 1875600
2026-01-28 20:21:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e64bf1f2-1376-55ce-b313-cda67cd7925e with identifier: 1875600 to the API
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e64bf1f2-1376-55ce-b313-cda67cd7925e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 88910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 45 TDi Quattro Tiptronic',
 'transmission': 'automatic',
 'trim': '45 TDi Quattro Tiptronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875600%27 HTTP/1.1" 200 None
2026-01-28 20:21:24 [ayvens.be] INFO: Saving data for 1875600: {'auction_closing_time': 1770021000.0, 'created_time': 1769544617.84268, 'last_price_update_time': 1769631684.553325}
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875600') HTTP/1.1" 204 0
2026-01-28 20:21:24 [ayvens.be] INFO: Found listing with ID: 1875601
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875601%27 HTTP/1.1" 200 None
2026-01-28 20:21:24 [ayvens.be] INFO: Scrape type for 1875601: 2
2026-01-28 20:21:24 [ayvens.be] INFO: Extracting data for car ID: 1875601
2026-01-28 20:21:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 926fc4f3-9288-58ac-93b5-062ac40fc97e with identifier: 1875601
2026-01-28 20:21:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926fc4f3-9288-58ac-93b5-062ac40fc97e with scrape type 2
2026-01-28 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 926fc4f3-9288-58ac-93b5-062ac40fc97e with scrape type 2
2026-01-28 20:21:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 926fc4f3-9288-58ac-93b5-062ac40fc97e, identifier: 1875601
2026-01-28 20:21:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 926fc4f3-9288-58ac-93b5-062ac40fc97e with identifier: 1875601
2026-01-28 20:21:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 926fc4f3-9288-58ac-93b5-062ac40fc97e with identifier: 1875601
2026-01-28 20:21:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 926fc4f3-9288-58ac-93b5-062ac40fc97e with identifier: 1875601 to the API
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'IVORY BLACK',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '926fc4f3-9288-58ac-93b5-062ac40fc97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'ARKANA',
 'odometer': 53641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT ARKANA 1.3 TCE MHEV 140 CORPORATE EDITION EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE MHEV 140 CORPORATE EDITION EDC',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875601%27 HTTP/1.1" 200 None
2026-01-28 20:21:25 [ayvens.be] INFO: Saving data for 1875601: {'auction_closing_time': 1770021000.0, 'created_time': 1769544627.413972, 'last_price_update_time': 1769631685.037862}
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875601') HTTP/1.1" 204 0
2026-01-28 20:21:25 [ayvens.be] INFO: Found listing with ID: 1875602
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875602%27 HTTP/1.1" 200 None
2026-01-28 20:21:25 [ayvens.be] INFO: Scrape type for 1875602: 2
2026-01-28 20:21:25 [ayvens.be] INFO: Extracting data for car ID: 1875602
2026-01-28 20:21:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with identifier: 1875602
2026-01-28 20:21:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with scrape type 2
2026-01-28 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with scrape type 2
2026-01-28 20:21:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ae84b5c4-3a2c-5fb7-b8b1-493873635ca5, identifier: 1875602
2026-01-28 20:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with identifier: 1875602
2026-01-28 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with identifier: 1875602
2026-01-28 20:21:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ae84b5c4-3a2c-5fb7-b8b1-493873635ca5 with identifier: 1875602 to the API
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ae84b5c4-3a2c-5fb7-b8b1-493873635ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 71086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 TECHNO',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 TECHNO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875602%27 HTTP/1.1" 200 None
2026-01-28 20:21:25 [ayvens.be] INFO: Saving data for 1875602: {'auction_closing_time': 1770021000.0, 'created_time': 1769544631.733135, 'last_price_update_time': 1769631685.72504}
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875602') HTTP/1.1" 204 0
2026-01-28 20:21:25 [ayvens.be] INFO: Found listing with ID: 1875603
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875603%27 HTTP/1.1" 200 None
2026-01-28 20:21:25 [ayvens.be] INFO: Scrape type for 1875603: 2
2026-01-28 20:21:25 [ayvens.be] INFO: Extracting data for car ID: 1875603
2026-01-28 20:21:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5e4aa0-90e6-50a3-b4f1-776237a07c56 with identifier: 1875603
2026-01-28 20:21:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5e4aa0-90e6-50a3-b4f1-776237a07c56 with scrape type 2
2026-01-28 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5e4aa0-90e6-50a3-b4f1-776237a07c56 with scrape type 2
2026-01-28 20:21:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: af5e4aa0-90e6-50a3-b4f1-776237a07c56, identifier: 1875603
2026-01-28 20:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: af5e4aa0-90e6-50a3-b4f1-776237a07c56 with identifier: 1875603
2026-01-28 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: af5e4aa0-90e6-50a3-b4f1-776237a07c56 with identifier: 1875603
2026-01-28 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168418 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    168418
2026-01-28 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: af5e4aa0-90e6-50a3-b4f1-776237a07c56 spider: ayvens.be
2026-01-28 20:21:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: af5e4aa0-90e6-50a3-b4f1-776237a07c56 due to rule: high_mileage_for_country.json, error: 168418 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    168418
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'af5e4aa0-90e6-50a3-b4f1-776237a07c56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 168418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875603%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Saving data for 1875603: {'auction_closing_time': 1770021000.0, 'created_time': 1769544666.354742, 'last_price_update_time': 1769631686.066237}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875603') HTTP/1.1" 204 0
2026-01-28 20:21:26 [ayvens.be] INFO: Found listing with ID: 1875604
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875604%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Scrape type for 1875604: 2
2026-01-28 20:21:26 [ayvens.be] INFO: Extracting data for car ID: 1875604
2026-01-28 20:21:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da7099b-15bf-5c29-bc79-152cabc4dd46 with identifier: 1875604
2026-01-28 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da7099b-15bf-5c29-bc79-152cabc4dd46 with scrape type 2
2026-01-28 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da7099b-15bf-5c29-bc79-152cabc4dd46 with scrape type 2
2026-01-28 20:21:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6da7099b-15bf-5c29-bc79-152cabc4dd46, identifier: 1875604
2026-01-28 20:21:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6da7099b-15bf-5c29-bc79-152cabc4dd46 with identifier: 1875604
2026-01-28 20:21:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6da7099b-15bf-5c29-bc79-152cabc4dd46 with identifier: 1875604
2026-01-28 20:21:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6da7099b-15bf-5c29-bc79-152cabc4dd46 with identifier: 1875604 to the API
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6da7099b-15bf-5c29-bc79-152cabc4dd46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 72498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.6 PURETECH 180 BASTILLE + AUTO',
 'transmission': 'automatic',
 'trim': '1.6 PURETECH 180 BASTILLE + AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875604%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Saving data for 1875604: {'auction_closing_time': 1770021000.0, 'created_time': 1769544665.775705, 'last_price_update_time': 1769631686.484614}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875604') HTTP/1.1" 204 0
2026-01-28 20:21:26 [ayvens.be] INFO: Found listing with ID: 1875605
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875605%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Scrape type for 1875605: 2
2026-01-28 20:21:26 [ayvens.be] INFO: Extracting data for car ID: 1875605
2026-01-28 20:21:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c67bd9c-3838-5dc5-badc-6817fc33c416 with identifier: 1875605
2026-01-28 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c67bd9c-3838-5dc5-badc-6817fc33c416 with scrape type 2
2026-01-28 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c67bd9c-3838-5dc5-badc-6817fc33c416 with scrape type 2
2026-01-28 20:21:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0c67bd9c-3838-5dc5-badc-6817fc33c416, identifier: 1875605
2026-01-28 20:21:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0c67bd9c-3838-5dc5-badc-6817fc33c416 with identifier: 1875605
2026-01-28 20:21:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0c67bd9c-3838-5dc5-badc-6817fc33c416 with identifier: 1875605
2026-01-28 20:21:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0c67bd9c-3838-5dc5-badc-6817fc33c416 with identifier: 1875605 to the API
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'electric',
 'id': '0c67bd9c-3838-5dc5-badc-6817fc33c416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ID.4',
 'odometer': 76425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ID.4 BEV 82KWH 150KW PRO PERFORMANCE',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 150KW PRO PERFORMANCE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875605%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Saving data for 1875605: {'auction_closing_time': 1770021000.0, 'created_time': 1769544661.94749, 'last_price_update_time': 1769631686.904178}
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875605') HTTP/1.1" 204 0
2026-01-28 20:21:26 [ayvens.be] INFO: Found listing with ID: 1875606
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875606%27 HTTP/1.1" 200 None
2026-01-28 20:21:26 [ayvens.be] INFO: Scrape type for 1875606: 2
2026-01-28 20:21:26 [ayvens.be] INFO: Extracting data for car ID: 1875606
2026-01-28 20:21:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a with identifier: 1875606
2026-01-28 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6b3fbb7-4d34-59ec-95ed-a499d6161b9a with scrape type 2
2026-01-28 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6b3fbb7-4d34-59ec-95ed-a499d6161b9a with scrape type 2
2026-01-28 20:21:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a, identifier: 1875606
2026-01-28 20:21:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a with identifier: 1875606
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a with identifier: 1875606
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 138527 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    138527
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a spider: ayvens.be
2026-01-28 20:21:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e6b3fbb7-4d34-59ec-95ed-a499d6161b9a due to rule: high_mileage_for_country.json, error: 138527 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    138527
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e6b3fbb7-4d34-59ec-95ed-a499d6161b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39120',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES BERLINE',
 'odometer': 138527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES BERLINE 2.0 320D (120KW) BERLINE',
 'transmission': 'manual',
 'trim': '2.0 320D (120KW) BERLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271875606%27 HTTP/1.1" 200 None
2026-01-28 20:21:27 [ayvens.be] INFO: Saving data for 1875606: {'auction_closing_time': 1770021000.0, 'created_time': 1769544662.181127, 'last_price_update_time': 1769631687.247563}
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1875606') HTTP/1.1" 204 0
2026-01-28 20:21:27 [ayvens.be] INFO: Found listing with ID: 1877036
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877036%27 HTTP/1.1" 200 None
2026-01-28 20:21:27 [ayvens.be] INFO: Scrape type for 1877036: 2
2026-01-28 20:21:27 [ayvens.be] INFO: Extracting data for car ID: 1877036
2026-01-28 20:21:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df41fd81-ebfb-55d2-8788-0b5b349e561e with identifier: 1877036
2026-01-28 20:21:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df41fd81-ebfb-55d2-8788-0b5b349e561e with scrape type 2
2026-01-28 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df41fd81-ebfb-55d2-8788-0b5b349e561e with scrape type 2
2026-01-28 20:21:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df41fd81-ebfb-55d2-8788-0b5b349e561e, identifier: 1877036
2026-01-28 20:21:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df41fd81-ebfb-55d2-8788-0b5b349e561e with identifier: 1877036
2026-01-28 20:21:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df41fd81-ebfb-55d2-8788-0b5b349e561e with identifier: 1877036
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152084 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152084
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: df41fd81-ebfb-55d2-8788-0b5b349e561e spider: ayvens.be
2026-01-28 20:21:27 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: df41fd81-ebfb-55d2-8788-0b5b349e561e due to rule: high_mileage_for_country.json, error: 152084 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152084
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'X',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df41fd81-ebfb-55d2-8788-0b5b349e561e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TOURAN - 2015',
 'odometer': 152084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLKSWAGEN TOURAN - 2015 1.5 TSI ACT Highline OPF DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI ACT Highline OPF DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877036%27 HTTP/1.1" 200 None
2026-01-28 20:21:27 [ayvens.be] INFO: Saving data for 1877036: {'auction_closing_time': 1770019200.0, 'created_time': 1769544658.952634, 'last_price_update_time': 1769631687.590151}
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877036') HTTP/1.1" 204 0
2026-01-28 20:21:27 [ayvens.be] INFO: Found listing with ID: 1877037
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877037%27 HTTP/1.1" 200 None
2026-01-28 20:21:27 [ayvens.be] INFO: Scrape type for 1877037: 2
2026-01-28 20:21:27 [ayvens.be] INFO: Extracting data for car ID: 1877037
2026-01-28 20:21:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39533b5e-6370-5e12-a0dd-85746991d1b4 with identifier: 1877037
2026-01-28 20:21:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39533b5e-6370-5e12-a0dd-85746991d1b4 with scrape type 2
2026-01-28 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39533b5e-6370-5e12-a0dd-85746991d1b4 with scrape type 2
2026-01-28 20:21:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39533b5e-6370-5e12-a0dd-85746991d1b4, identifier: 1877037
2026-01-28 20:21:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39533b5e-6370-5e12-a0dd-85746991d1b4 with identifier: 1877037
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39533b5e-6370-5e12-a0dd-85746991d1b4 with identifier: 1877037
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:21:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 39533b5e-6370-5e12-a0dd-85746991d1b4 spider: ayvens.be
2026-01-28 20:21:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 39533b5e-6370-5e12-a0dd-85746991d1b4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '39533b5e-6370-5e12-a0dd-85746991d1b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 91980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877037%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Saving data for 1877037: {'auction_closing_time': 1770019200.0, 'created_time': 1769544757.614549, 'last_price_update_time': 1769631688.051054}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877037') HTTP/1.1" 204 0
2026-01-28 20:21:28 [ayvens.be] INFO: Found listing with ID: 1877038
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877038%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Scrape type for 1877038: 2
2026-01-28 20:21:28 [ayvens.be] INFO: Extracting data for car ID: 1877038
2026-01-28 20:21:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354f14db-85d9-5c87-86c1-cca9f5378ef4 with identifier: 1877038
2026-01-28 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354f14db-85d9-5c87-86c1-cca9f5378ef4 with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354f14db-85d9-5c87-86c1-cca9f5378ef4 with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 354f14db-85d9-5c87-86c1-cca9f5378ef4, identifier: 1877038
2026-01-28 20:21:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 354f14db-85d9-5c87-86c1-cca9f5378ef4 with identifier: 1877038
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 354f14db-85d9-5c87-86c1-cca9f5378ef4 with identifier: 1877038
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 354f14db-85d9-5c87-86c1-cca9f5378ef4 spider: ayvens.be
2026-01-28 20:21:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 354f14db-85d9-5c87-86c1-cca9f5378ef4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '354f14db-85d9-5c87-86c1-cca9f5378ef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 51177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877038%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Saving data for 1877038: {'auction_closing_time': 1770019200.0, 'created_time': 1769544753.459388, 'last_price_update_time': 1769631688.402463}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877038') HTTP/1.1" 204 0
2026-01-28 20:21:28 [ayvens.be] INFO: Found listing with ID: 1877039
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877039%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Scrape type for 1877039: 2
2026-01-28 20:21:28 [ayvens.be] INFO: Extracting data for car ID: 1877039
2026-01-28 20:21:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfdfb7e-18c4-53b3-9c42-37f710ec235a with identifier: 1877039
2026-01-28 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcfdfb7e-18c4-53b3-9c42-37f710ec235a with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcfdfb7e-18c4-53b3-9c42-37f710ec235a with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fcfdfb7e-18c4-53b3-9c42-37f710ec235a, identifier: 1877039
2026-01-28 20:21:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fcfdfb7e-18c4-53b3-9c42-37f710ec235a with identifier: 1877039
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fcfdfb7e-18c4-53b3-9c42-37f710ec235a with identifier: 1877039
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fcfdfb7e-18c4-53b3-9c42-37f710ec235a spider: ayvens.be
2026-01-28 20:21:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: fcfdfb7e-18c4-53b3-9c42-37f710ec235a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'fcfdfb7e-18c4-53b3-9c42-37f710ec235a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 84163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PREMIUM',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877039%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Saving data for 1877039: {'auction_closing_time': 1770019200.0, 'created_time': 1769544747.977059, 'last_price_update_time': 1769631688.726755}
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877039') HTTP/1.1" 204 0
2026-01-28 20:21:28 [ayvens.be] INFO: Found listing with ID: 1877040
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877040%27 HTTP/1.1" 200 None
2026-01-28 20:21:28 [ayvens.be] INFO: Scrape type for 1877040: 2
2026-01-28 20:21:28 [ayvens.be] INFO: Extracting data for car ID: 1877040
2026-01-28 20:21:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec50996-761a-5f0f-a320-88d2d5c409f7 with identifier: 1877040
2026-01-28 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec50996-761a-5f0f-a320-88d2d5c409f7 with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ec50996-761a-5f0f-a320-88d2d5c409f7 with scrape type 2
2026-01-28 20:21:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4ec50996-761a-5f0f-a320-88d2d5c409f7, identifier: 1877040
2026-01-28 20:21:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4ec50996-761a-5f0f-a320-88d2d5c409f7 with identifier: 1877040
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4ec50996-761a-5f0f-a320-88d2d5c409f7 with identifier: 1877040
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4ec50996-761a-5f0f-a320-88d2d5c409f7 spider: ayvens.be
2026-01-28 20:21:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4ec50996-761a-5f0f-a320-88d2d5c409f7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '4ec50996-761a-5f0f-a320-88d2d5c409f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT',
 'odometer': 42537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT 1.5 BLUEHDI 100 S&S LONG PRO',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 S&S LONG PRO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877040%27 HTTP/1.1" 200 None
2026-01-28 20:21:29 [ayvens.be] INFO: Saving data for 1877040: {'auction_closing_time': 1770019200.0, 'created_time': 1769544692.976972, 'last_price_update_time': 1769631689.056083}
2026-01-28 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877040') HTTP/1.1" 204 0
2026-01-28 20:21:29 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-01-28 20:21:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:21:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:21:31 [ayvens.be] INFO: Found listing with ID: 1877041
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877041%27 HTTP/1.1" 200 None
2026-01-28 20:21:31 [ayvens.be] INFO: Scrape type for 1877041: 2
2026-01-28 20:21:31 [ayvens.be] INFO: Extracting data for car ID: 1877041
2026-01-28 20:21:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 646b928e-6b7d-5e5f-b969-902734ec1842 with identifier: 1877041
2026-01-28 20:21:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 646b928e-6b7d-5e5f-b969-902734ec1842 with scrape type 2
2026-01-28 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 646b928e-6b7d-5e5f-b969-902734ec1842 with scrape type 2
2026-01-28 20:21:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 646b928e-6b7d-5e5f-b969-902734ec1842, identifier: 1877041
2026-01-28 20:21:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 646b928e-6b7d-5e5f-b969-902734ec1842 with identifier: 1877041
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 646b928e-6b7d-5e5f-b969-902734ec1842 with identifier: 1877041
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149981 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149981
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 646b928e-6b7d-5e5f-b969-902734ec1842 spider: ayvens.be
2026-01-28 20:21:31 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 646b928e-6b7d-5e5f-b969-902734ec1842 due to rule: high_mileage_for_country.json, error: 149981 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    149981
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '646b928e-6b7d-5e5f-b969-902734ec1842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1-serie',
 'odometer': 149981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1-serie 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877041%27 HTTP/1.1" 200 None
2026-01-28 20:21:31 [ayvens.be] INFO: Saving data for 1877041: {'auction_closing_time': 1770019200.0, 'created_time': 1769544742.438916, 'last_price_update_time': 1769631691.736104}
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877041') HTTP/1.1" 204 0
2026-01-28 20:21:31 [ayvens.be] INFO: Found listing with ID: 1877042
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877042%27 HTTP/1.1" 200 None
2026-01-28 20:21:31 [ayvens.be] INFO: Scrape type for 1877042: 2
2026-01-28 20:21:31 [ayvens.be] INFO: Extracting data for car ID: 1877042
2026-01-28 20:21:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8901e6-e976-5b2f-b217-0a556c873f46 with identifier: 1877042
2026-01-28 20:21:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8901e6-e976-5b2f-b217-0a556c873f46 with scrape type 2
2026-01-28 20:21:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8901e6-e976-5b2f-b217-0a556c873f46 with scrape type 2
2026-01-28 20:21:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4c8901e6-e976-5b2f-b217-0a556c873f46, identifier: 1877042
2026-01-28 20:21:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4c8901e6-e976-5b2f-b217-0a556c873f46 with identifier: 1877042
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4c8901e6-e976-5b2f-b217-0a556c873f46 with identifier: 1877042
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
2026-01-28 20:21:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4c8901e6-e976-5b2f-b217-0a556c873f46 spider: ayvens.be
2026-01-28 20:21:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4c8901e6-e976-5b2f-b217-0a556c873f46 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'transporter' containing 'transporter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '4c8901e6-e976-5b2f-b217-0a556c873f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Transporter',
 'odometer': 173407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-25',
 'seats_number': 6,
 'seller_name': None,
 'title': 'VOLKSWAGEN Transporter 2.0CRTDI 110KW BMT DSG 4WD LWB 2.8T DC',
 'transmission': 'automatic',
 'trim': '2.0CRTDI 110KW BMT DSG 4WD LWB 2.8T DC',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877042%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Saving data for 1877042: {'auction_closing_time': 1770019200.0, 'created_time': 1769544725.624841, 'last_price_update_time': 1769631692.072594}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877042') HTTP/1.1" 204 0
2026-01-28 20:21:32 [ayvens.be] INFO: Found listing with ID: 1877043
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877043%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Scrape type for 1877043: 2
2026-01-28 20:21:32 [ayvens.be] INFO: Extracting data for car ID: 1877043
2026-01-28 20:21:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84a5c985-d171-55f0-b1bb-7253833e13e7 with identifier: 1877043
2026-01-28 20:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84a5c985-d171-55f0-b1bb-7253833e13e7 with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84a5c985-d171-55f0-b1bb-7253833e13e7 with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 84a5c985-d171-55f0-b1bb-7253833e13e7, identifier: 1877043
2026-01-28 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 84a5c985-d171-55f0-b1bb-7253833e13e7 with identifier: 1877043
2026-01-28 20:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 84a5c985-d171-55f0-b1bb-7253833e13e7 with identifier: 1877043
2026-01-28 20:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188809 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    188809
2026-01-28 20:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 84a5c985-d171-55f0-b1bb-7253833e13e7 spider: ayvens.be
2026-01-28 20:21:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 84a5c985-d171-55f0-b1bb-7253833e13e7 due to rule: high_mileage_for_country.json, error: 188809 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    188809
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '84a5c985-d171-55f0-b1bb-7253833e13e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 188809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI 96KW S&S ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 96KW S&S ACTIVE PACK',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877043%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Saving data for 1877043: {'auction_closing_time': 1770019200.0, 'created_time': 1769544722.462285, 'last_price_update_time': 1769631692.421552}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877043') HTTP/1.1" 204 0
2026-01-28 20:21:32 [ayvens.be] INFO: Found listing with ID: 1877044
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877044%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Scrape type for 1877044: 2
2026-01-28 20:21:32 [ayvens.be] INFO: Extracting data for car ID: 1877044
2026-01-28 20:21:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb089a17-b8ce-5405-af65-6a1e33a7565b with identifier: 1877044
2026-01-28 20:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb089a17-b8ce-5405-af65-6a1e33a7565b with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb089a17-b8ce-5405-af65-6a1e33a7565b with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eb089a17-b8ce-5405-af65-6a1e33a7565b, identifier: 1877044
2026-01-28 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eb089a17-b8ce-5405-af65-6a1e33a7565b with identifier: 1877044
2026-01-28 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eb089a17-b8ce-5405-af65-6a1e33a7565b with identifier: 1877044
2026-01-28 20:21:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: eb089a17-b8ce-5405-af65-6a1e33a7565b with identifier: 1877044 to the API
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'DENIM BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'eb089a17-b8ce-5405-af65-6a1e33a7565b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 59921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877044%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Saving data for 1877044: {'auction_closing_time': 1770019200.0, 'created_time': 1769544714.191757, 'last_price_update_time': 1769631692.849821}
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877044') HTTP/1.1" 204 0
2026-01-28 20:21:32 [ayvens.be] INFO: Found listing with ID: 1877045
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877045%27 HTTP/1.1" 200 None
2026-01-28 20:21:32 [ayvens.be] INFO: Scrape type for 1877045: 2
2026-01-28 20:21:32 [ayvens.be] INFO: Extracting data for car ID: 1877045
2026-01-28 20:21:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 with identifier: 1877045
2026-01-28 20:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 with scrape type 2
2026-01-28 20:21:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8, identifier: 1877045
2026-01-28 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 with identifier: 1877045
2026-01-28 20:21:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 with identifier: 1877045
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'jade white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'vivaro', 'trim': '1.5 turbo 75kw comfort l3h1 2.8t', 'title': 'opel vivaro 1.5 turbo 75kw comfort l3h1 2.8t', 'price': 0, 'odometer': 221628, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-10', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 135, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '395ddd1c-2677-5e0e-857c-f60c72a6cdd8', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'opel vivaro', 'sanitized_make': 'opel', 'odometer_in_km': 221628}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'color': 'jade white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '395ddd1c-2677-5e0e-857c-f60c72a6cdd8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'opel',
     'make_model': 'opel vivaro',
     'model': 'vivaro',
     'odometer': 221628,
     'odometer_in_km': 221628,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-10',
     'sanitized_make': 'opel',
     'seats_number': 2,
     'seller_name': None,
     'title': 'opel vivaro 1.5 turbo 75kw comfort l3h1 2.8t',
     'transmission': 'manual',
     'trim': '1.5 turbo 75kw comfort l3h1 2.8t',
     'vin': None,
     'year': 2020}
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 spider: ayvens.be
2026-01-28 20:21:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 395ddd1c-2677-5e0e-857c-f60c72a6cdd8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'jade white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'vivaro', 'trim': '1.5 turbo 75kw comfort l3h1 2.8t', 'title': 'opel vivaro 1.5 turbo 75kw comfort l3h1 2.8t', 'price': 0, 'odometer': 221628, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-10', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 135, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '395ddd1c-2677-5e0e-857c-f60c72a6cdd8', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'opel vivaro', 'sanitized_make': 'opel', 'odometer_in_km': 221628}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': 135,
     'color': 'jade white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '395ddd1c-2677-5e0e-857c-f60c72a6cdd8',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'opel',
     'make_model': 'opel vivaro',
     'model': 'vivaro',
     'odometer': 221628,
     'odometer_in_km': 221628,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-10',
     'sanitized_make': 'opel',
     'seats_number': 2,
     'seller_name': None,
     'title': 'opel vivaro 1.5 turbo 75kw comfort l3h1 2.8t',
     'transmission': 'manual',
     'trim': '1.5 turbo 75kw comfort l3h1 2.8t',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'JADE WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '395ddd1c-2677-5e0e-857c-f60c72a6cdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 221628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877045%27 HTTP/1.1" 200 None
2026-01-28 20:21:33 [ayvens.be] INFO: Saving data for 1877045: {'auction_closing_time': 1770019200.0, 'created_time': 1769544716.429468, 'last_price_update_time': 1769631693.212393}
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877045') HTTP/1.1" 204 0
2026-01-28 20:21:33 [ayvens.be] INFO: Found listing with ID: 1877046
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877046%27 HTTP/1.1" 200 None
2026-01-28 20:21:33 [ayvens.be] INFO: Scrape type for 1877046: 2
2026-01-28 20:21:33 [ayvens.be] INFO: Extracting data for car ID: 1877046
2026-01-28 20:21:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3630e338-b0b1-54d6-8027-221c89e5ecc5 with identifier: 1877046
2026-01-28 20:21:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3630e338-b0b1-54d6-8027-221c89e5ecc5 with scrape type 2
2026-01-28 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3630e338-b0b1-54d6-8027-221c89e5ecc5 with scrape type 2
2026-01-28 20:21:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3630e338-b0b1-54d6-8027-221c89e5ecc5, identifier: 1877046
2026-01-28 20:21:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3630e338-b0b1-54d6-8027-221c89e5ecc5 with identifier: 1877046
2026-01-28 20:21:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3630e338-b0b1-54d6-8027-221c89e5ecc5 with identifier: 1877046
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic 29 fourgon swb dsl - 20' containing 'trafic'
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3630e338-b0b1-54d6-8027-221c89e5ecc5 spider: ayvens.be
2026-01-28 20:21:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3630e338-b0b1-54d6-8027-221c89e5ecc5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic 29 fourgon swb dsl - 20' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'BLANC GLACIER',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '3630e338-b0b1-54d6-8027-221c89e5ecc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON SWB DSL - 20',
 'odometer': 69841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON SWB DSL - 20 1.6 dCi 29 L1H1 Energy '
          'Tw.Turbo Gd Conf. STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L1H1 Energy Tw.Turbo Gd Conf. STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877046%27 HTTP/1.1" 200 None
2026-01-28 20:21:33 [ayvens.be] INFO: Saving data for 1877046: {'auction_closing_time': 1770019200.0, 'created_time': 1769544722.226036, 'last_price_update_time': 1769631693.732238}
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877046') HTTP/1.1" 204 0
2026-01-28 20:21:33 [ayvens.be] INFO: Found listing with ID: 1877047
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877047%27 HTTP/1.1" 200 None
2026-01-28 20:21:33 [ayvens.be] INFO: Scrape type for 1877047: 2
2026-01-28 20:21:33 [ayvens.be] INFO: Extracting data for car ID: 1877047
2026-01-28 20:21:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 with identifier: 1877047
2026-01-28 20:21:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 with scrape type 2
2026-01-28 20:21:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 with scrape type 2
2026-01-28 20:21:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97, identifier: 1877047
2026-01-28 20:21:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 with identifier: 1877047
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 with identifier: 1877047
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert fourgon mwb dsl - 2016' containing 'expert'
2026-01-28 20:21:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 spider: ayvens.be
2026-01-28 20:21:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0f9e7b02-a3a1-53e3-9164-34e48f1d4f97 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert fourgon mwb dsl - 2016' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f9e7b02-a3a1-53e3-9164-34e48f1d4f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'EXPERT FOURGON MWB DSL - 2016',
 'odometer': 130433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT EXPERT FOURGON MWB DSL - 2016 2.0 BlueHDi L3 Long Premium '
          'S&S',
 'transmission': 'automatic',
 'trim': '2.0 BlueHDi L3 Long Premium S&S',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877047%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Saving data for 1877047: {'auction_closing_time': 1770019200.0, 'created_time': 1769544739.430816, 'last_price_update_time': 1769631694.066176}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877047') HTTP/1.1" 204 0
2026-01-28 20:21:34 [ayvens.be] INFO: Found listing with ID: 1877048
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877048%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Scrape type for 1877048: 2
2026-01-28 20:21:34 [ayvens.be] INFO: Extracting data for car ID: 1877048
2026-01-28 20:21:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3ace04-a856-5d8e-9a36-faed49b5769c with identifier: 1877048
2026-01-28 20:21:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3ace04-a856-5d8e-9a36-faed49b5769c with scrape type 2
2026-01-28 20:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c3ace04-a856-5d8e-9a36-faed49b5769c with scrape type 2
2026-01-28 20:21:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3c3ace04-a856-5d8e-9a36-faed49b5769c, identifier: 1877048
2026-01-28 20:21:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3c3ace04-a856-5d8e-9a36-faed49b5769c with identifier: 1877048
2026-01-28 20:21:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3c3ace04-a856-5d8e-9a36-faed49b5769c with identifier: 1877048
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3c3ace04-a856-5d8e-9a36-faed49b5769c spider: ayvens.be
2026-01-28 20:21:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3c3ace04-a856-5d8e-9a36-faed49b5769c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '3c3ace04-a856-5d8e-9a36-faed49b5769c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 121828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Grand Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Grand Confort',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877048%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Saving data for 1877048: {'auction_closing_time': 1770019200.0, 'created_time': 1769544737.981794, 'last_price_update_time': 1769631694.52664}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877048') HTTP/1.1" 204 0
2026-01-28 20:21:34 [ayvens.be] INFO: Found listing with ID: 1877049
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877049%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Scrape type for 1877049: 2
2026-01-28 20:21:34 [ayvens.be] INFO: Extracting data for car ID: 1877049
2026-01-28 20:21:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738d21a4-510b-5963-832d-c5d50f3262a0 with identifier: 1877049
2026-01-28 20:21:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738d21a4-510b-5963-832d-c5d50f3262a0 with scrape type 2
2026-01-28 20:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738d21a4-510b-5963-832d-c5d50f3262a0 with scrape type 2
2026-01-28 20:21:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 738d21a4-510b-5963-832d-c5d50f3262a0, identifier: 1877049
2026-01-28 20:21:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 738d21a4-510b-5963-832d-c5d50f3262a0 with identifier: 1877049
2026-01-28 20:21:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 738d21a4-510b-5963-832d-c5d50f3262a0 with identifier: 1877049
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135240 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    135240
2026-01-28 20:21:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 738d21a4-510b-5963-832d-c5d50f3262a0 spider: ayvens.be
2026-01-28 20:21:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 738d21a4-510b-5963-832d-c5d50f3262a0 due to rule: high_mileage_for_country.json, error: 135240 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    135240
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '738d21a4-510b-5963-832d-c5d50f3262a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 HATCH DIESEL - 2019',
 'odometer': 135240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 HATCH DIESEL - 2019 116 dA AdBlue',
 'transmission': 'automatic',
 'trim': '116 dA AdBlue',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877049%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Saving data for 1877049: {'auction_closing_time': 1770019200.0, 'created_time': 1769544738.235337, 'last_price_update_time': 1769631694.909103}
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877049') HTTP/1.1" 204 0
2026-01-28 20:21:34 [ayvens.be] INFO: Found listing with ID: 1877050
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877050%27 HTTP/1.1" 200 None
2026-01-28 20:21:34 [ayvens.be] INFO: Scrape type for 1877050: 2
2026-01-28 20:21:34 [ayvens.be] INFO: Extracting data for car ID: 1877050
2026-01-28 20:21:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f905998-30f9-5038-8186-39d4a89786f9 with identifier: 1877050
2026-01-28 20:21:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f905998-30f9-5038-8186-39d4a89786f9 with scrape type 2
2026-01-28 20:21:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f905998-30f9-5038-8186-39d4a89786f9 with scrape type 2
2026-01-28 20:21:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f905998-30f9-5038-8186-39d4a89786f9, identifier: 1877050
2026-01-28 20:21:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f905998-30f9-5038-8186-39d4a89786f9 with identifier: 1877050
2026-01-28 20:21:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f905998-30f9-5038-8186-39d4a89786f9 with identifier: 1877050
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184121 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    184121
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0f905998-30f9-5038-8186-39d4a89786f9 spider: ayvens.be
2026-01-28 20:21:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0f905998-30f9-5038-8186-39d4a89786f9 due to rule: high_mileage_for_country.json, error: 184121 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    184121
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'VOIR OFFRE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f905998-30f9-5038-8186-39d4a89786f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008 DIESEL - 2016',
 'odometer': 184121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 DIESEL - 2016 1.5 BlueHDi Allure (EU6.2)',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure (EU6.2)',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877050%27 HTTP/1.1" 200 None
2026-01-28 20:21:35 [ayvens.be] INFO: Saving data for 1877050: {'auction_closing_time': 1770019200.0, 'created_time': 1769544745.741759, 'last_price_update_time': 1769631695.28256}
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877050') HTTP/1.1" 204 0
2026-01-28 20:21:35 [ayvens.be] INFO: Found listing with ID: 1877051
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877051%27 HTTP/1.1" 200 None
2026-01-28 20:21:35 [ayvens.be] INFO: Scrape type for 1877051: 2
2026-01-28 20:21:35 [ayvens.be] INFO: Extracting data for car ID: 1877051
2026-01-28 20:21:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77b4f20b-848b-598b-b555-ff0e85b1cc6c with identifier: 1877051
2026-01-28 20:21:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77b4f20b-848b-598b-b555-ff0e85b1cc6c with scrape type 2
2026-01-28 20:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77b4f20b-848b-598b-b555-ff0e85b1cc6c with scrape type 2
2026-01-28 20:21:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 77b4f20b-848b-598b-b555-ff0e85b1cc6c, identifier: 1877051
2026-01-28 20:21:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 77b4f20b-848b-598b-b555-ff0e85b1cc6c with identifier: 1877051
2026-01-28 20:21:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 77b4f20b-848b-598b-b555-ff0e85b1cc6c with identifier: 1877051
2026-01-28 20:21:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 77b4f20b-848b-598b-b555-ff0e85b1cc6c with identifier: 1877051 to the API
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BRIGHT SILVER METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '77b4f20b-848b-598b-b555-ff0e85b1cc6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40 DIESEL',
 'odometer': 112914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 DIESEL 2.0 D3 AWD Momentum Gear. (EU6d-TEMP) STOCK',
 'transmission': 'automatic',
 'trim': '2.0 D3 AWD Momentum Gear. (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877051%27 HTTP/1.1" 200 None
2026-01-28 20:21:35 [ayvens.be] INFO: Saving data for 1877051: {'auction_closing_time': 1770019200.0, 'created_time': 1769544750.290145, 'last_price_update_time': 1769631695.711426}
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877051') HTTP/1.1" 204 0
2026-01-28 20:21:35 [ayvens.be] INFO: Found listing with ID: 1877052
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877052%27 HTTP/1.1" 200 None
2026-01-28 20:21:35 [ayvens.be] INFO: Scrape type for 1877052: 2
2026-01-28 20:21:35 [ayvens.be] INFO: Extracting data for car ID: 1877052
2026-01-28 20:21:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fb2c8d-6c28-5687-9bd7-564d62931995 with identifier: 1877052
2026-01-28 20:21:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fb2c8d-6c28-5687-9bd7-564d62931995 with scrape type 2
2026-01-28 20:21:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39fb2c8d-6c28-5687-9bd7-564d62931995 with scrape type 2
2026-01-28 20:21:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39fb2c8d-6c28-5687-9bd7-564d62931995, identifier: 1877052
2026-01-28 20:21:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39fb2c8d-6c28-5687-9bd7-564d62931995 with identifier: 1877052
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39fb2c8d-6c28-5687-9bd7-564d62931995 with identifier: 1877052
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
2026-01-28 20:21:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 39fb2c8d-6c28-5687-9bd7-564d62931995 spider: ayvens.be
2026-01-28 20:21:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 39fb2c8d-6c28-5687-9bd7-564d62931995 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '39fb2c8d-6c28-5687-9bd7-564d62931995',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 139310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-03',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877052%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Saving data for 1877052: {'auction_closing_time': 1770019200.0, 'created_time': 1769544757.391657, 'last_price_update_time': 1769631696.062005}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877052') HTTP/1.1" 204 0
2026-01-28 20:21:36 [ayvens.be] INFO: Found listing with ID: 1877053
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877053%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Scrape type for 1877053: 2
2026-01-28 20:21:36 [ayvens.be] INFO: Extracting data for car ID: 1877053
2026-01-28 20:21:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 with identifier: 1877053
2026-01-28 20:21:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3, identifier: 1877053
2026-01-28 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 with identifier: 1877053
2026-01-28 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 with identifier: 1877053
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter 300 lwb dsl - 2018' containing 'sprinter'
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 spider: ayvens.be
2026-01-28 20:21:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: bcacb5b2-f462-5f89-b8a5-5e970a02a8a3 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter 300 lwb dsl - 2018' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 217,
 'color': 'BLANC ARCTIQUE',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bcacb5b2-f462-5f89-b8a5-5e970a02a8a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'SPRINTER 300 LWB DSL - 2018',
 'odometer': 186057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'MERCEDES-BENZ SPRINTER 300 LWB DSL - 2018 314 2.1 CDI L3H1 RWD '
          '7G-tronic Plus',
 'transmission': 'automatic',
 'trim': '314 2.1 CDI L3H1 RWD 7G-tronic Plus',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877053%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Saving data for 1877053: {'auction_closing_time': 1770019200.0, 'created_time': 1769544764.065884, 'last_price_update_time': 1769631696.412088}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877053') HTTP/1.1" 204 0
2026-01-28 20:21:36 [ayvens.be] INFO: Found listing with ID: 1877054
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877054%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Scrape type for 1877054: 2
2026-01-28 20:21:36 [ayvens.be] INFO: Extracting data for car ID: 1877054
2026-01-28 20:21:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79cf99ec-2a1c-588c-85c7-bd2390433e06 with identifier: 1877054
2026-01-28 20:21:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79cf99ec-2a1c-588c-85c7-bd2390433e06 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79cf99ec-2a1c-588c-85c7-bd2390433e06 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 79cf99ec-2a1c-588c-85c7-bd2390433e06, identifier: 1877054
2026-01-28 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 79cf99ec-2a1c-588c-85c7-bd2390433e06 with identifier: 1877054
2026-01-28 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 79cf99ec-2a1c-588c-85c7-bd2390433e06 with identifier: 1877054
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 79cf99ec-2a1c-588c-85c7-bd2390433e06 spider: ayvens.be
2026-01-28 20:21:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 79cf99ec-2a1c-588c-85c7-bd2390433e06 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'ICE WHITE UNI',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '79cf99ec-2a1c-588c-85c7-bd2390433e06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'BOXER',
 'odometer': 123023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'PEUGEOT BOXER 2.2 BLUEHDI S-S 120 PREMIUM 335 L3H2',
 'transmission': 'manual',
 'trim': '2.2 BLUEHDI S-S 120 PREMIUM 335 L3H2',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877054%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Saving data for 1877054: {'auction_closing_time': 1770019200.0, 'created_time': 1769544772.824067, 'last_price_update_time': 1769631696.739889}
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877054') HTTP/1.1" 204 0
2026-01-28 20:21:36 [ayvens.be] INFO: Found listing with ID: 1877055
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877055%27 HTTP/1.1" 200 None
2026-01-28 20:21:36 [ayvens.be] INFO: Scrape type for 1877055: 2
2026-01-28 20:21:36 [ayvens.be] INFO: Extracting data for car ID: 1877055
2026-01-28 20:21:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 with identifier: 1877055
2026-01-28 20:21:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 with scrape type 2
2026-01-28 20:21:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319, identifier: 1877055
2026-01-28 20:21:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 with identifier: 1877055
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 with identifier: 1877055
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
2026-01-28 20:21:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 spider: ayvens.be
2026-01-28 20:21:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi diesel' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '2e0f4a48-a2eb-50c6-a1d4-ee8360ef4319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DIESEL',
 'odometer': 61052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-13',
 'seats_number': None,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DIESEL Lot 1.3 RENAULT KANGOO EXPRESS '
          'Maxi 1.5 dCi Blue Confort',
 'transmission': 'manual',
 'trim': 'Lot 1.3 RENAULT KANGOO EXPRESS Maxi 1.5 dCi Blue Confort',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877055%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Saving data for 1877055: {'auction_closing_time': 1770019200.0, 'created_time': 1769545142.511346, 'last_price_update_time': 1769631697.077434}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877055') HTTP/1.1" 204 0
2026-01-28 20:21:37 [ayvens.be] INFO: Found listing with ID: 1877056
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877056%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Scrape type for 1877056: 2
2026-01-28 20:21:37 [ayvens.be] INFO: Extracting data for car ID: 1877056
2026-01-28 20:21:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0241db2a-c41a-5076-bc80-cececa9e578b with identifier: 1877056
2026-01-28 20:21:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0241db2a-c41a-5076-bc80-cececa9e578b with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0241db2a-c41a-5076-bc80-cececa9e578b with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0241db2a-c41a-5076-bc80-cececa9e578b, identifier: 1877056
2026-01-28 20:21:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0241db2a-c41a-5076-bc80-cececa9e578b with identifier: 1877056
2026-01-28 20:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0241db2a-c41a-5076-bc80-cececa9e578b with identifier: 1877056
2026-01-28 20:21:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0241db2a-c41a-5076-bc80-cececa9e578b with identifier: 1877056 to the API
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0241db2a-c41a-5076-bc80-cececa9e578b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT',
 'odometer': 99380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT 2.0 30 TDI 100KW S TR S LINE BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 30 TDI 100KW S TR S LINE BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877056%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Saving data for 1877056: {'auction_closing_time': 1770019200.0, 'created_time': 1769545141.070711, 'last_price_update_time': 1769631697.47696}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877056') HTTP/1.1" 204 0
2026-01-28 20:21:37 [ayvens.be] INFO: Found listing with ID: 1877057
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877057%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Scrape type for 1877057: 2
2026-01-28 20:21:37 [ayvens.be] INFO: Extracting data for car ID: 1877057
2026-01-28 20:21:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8351c7f-f09e-534e-b3f2-19965efffe1f with identifier: 1877057
2026-01-28 20:21:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8351c7f-f09e-534e-b3f2-19965efffe1f with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8351c7f-f09e-534e-b3f2-19965efffe1f with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8351c7f-f09e-534e-b3f2-19965efffe1f, identifier: 1877057
2026-01-28 20:21:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8351c7f-f09e-534e-b3f2-19965efffe1f with identifier: 1877057
2026-01-28 20:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8351c7f-f09e-534e-b3f2-19965efffe1f with identifier: 1877057
2026-01-28 20:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e8351c7f-f09e-534e-b3f2-19965efffe1f spider: ayvens.be
2026-01-28 20:21:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e8351c7f-f09e-534e-b3f2-19965efffe1f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e8351c7f-f09e-534e-b3f2-19965efffe1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'COMBO',
 'odometer': 74520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL COMBO 1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'transmission': 'manual',
 'trim': '1.5 TURBO D 75KW 2.3T L2H1 COMFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877057%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Saving data for 1877057: {'auction_closing_time': 1770019200.0, 'created_time': 1769545136.399925, 'last_price_update_time': 1769631697.84683}
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877057') HTTP/1.1" 204 0
2026-01-28 20:21:37 [ayvens.be] INFO: Found listing with ID: 1877058
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877058%27 HTTP/1.1" 200 None
2026-01-28 20:21:37 [ayvens.be] INFO: Scrape type for 1877058: 2
2026-01-28 20:21:37 [ayvens.be] INFO: Extracting data for car ID: 1877058
2026-01-28 20:21:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00470de6-388e-532f-8589-b9a71eb2af32 with identifier: 1877058
2026-01-28 20:21:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00470de6-388e-532f-8589-b9a71eb2af32 with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00470de6-388e-532f-8589-b9a71eb2af32 with scrape type 2
2026-01-28 20:21:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 00470de6-388e-532f-8589-b9a71eb2af32, identifier: 1877058
2026-01-28 20:21:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 00470de6-388e-532f-8589-b9a71eb2af32 with identifier: 1877058
2026-01-28 20:21:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 00470de6-388e-532f-8589-b9a71eb2af32 with identifier: 1877058
2026-01-28 20:21:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 00470de6-388e-532f-8589-b9a71eb2af32 with identifier: 1877058 to the API
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'PENTA METAL METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '00470de6-388e-532f-8589-b9a71eb2af32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'XCEED',
 'odometer': 87927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA XCEED 1.6 CRDI 136 DCT SENSE',
 'transmission': 'automatic',
 'trim': '1.6 CRDI 136 DCT SENSE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877058%27 HTTP/1.1" 200 None
2026-01-28 20:21:38 [ayvens.be] INFO: Saving data for 1877058: {'auction_closing_time': 1770019200.0, 'created_time': 1769544827.981898, 'last_price_update_time': 1769631698.286303}
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877058') HTTP/1.1" 204 0
2026-01-28 20:21:38 [ayvens.be] INFO: Found listing with ID: 1877059
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877059%27 HTTP/1.1" 200 None
2026-01-28 20:21:38 [ayvens.be] INFO: Scrape type for 1877059: 2
2026-01-28 20:21:38 [ayvens.be] INFO: Extracting data for car ID: 1877059
2026-01-28 20:21:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 020a05f2-0ab2-525e-8f4e-111477bbd74d with identifier: 1877059
2026-01-28 20:21:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 020a05f2-0ab2-525e-8f4e-111477bbd74d with scrape type 2
2026-01-28 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 020a05f2-0ab2-525e-8f4e-111477bbd74d with scrape type 2
2026-01-28 20:21:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 020a05f2-0ab2-525e-8f4e-111477bbd74d, identifier: 1877059
2026-01-28 20:21:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 020a05f2-0ab2-525e-8f4e-111477bbd74d with identifier: 1877059
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 020a05f2-0ab2-525e-8f4e-111477bbd74d with identifier: 1877059
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 020a05f2-0ab2-525e-8f4e-111477bbd74d spider: ayvens.be
2026-01-28 20:21:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 020a05f2-0ab2-525e-8f4e-111477bbd74d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '020a05f2-0ab2-525e-8f4e-111477bbd74d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 151908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877059%27 HTTP/1.1" 200 None
2026-01-28 20:21:38 [ayvens.be] INFO: Saving data for 1877059: {'auction_closing_time': 1770019200.0, 'created_time': 1769544815.109022, 'last_price_update_time': 1769631698.715791}
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877059') HTTP/1.1" 204 0
2026-01-28 20:21:38 [ayvens.be] INFO: Found listing with ID: 1877060
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877060%27 HTTP/1.1" 200 None
2026-01-28 20:21:38 [ayvens.be] INFO: Scrape type for 1877060: 2
2026-01-28 20:21:38 [ayvens.be] INFO: Extracting data for car ID: 1877060
2026-01-28 20:21:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc with identifier: 1877060
2026-01-28 20:21:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc with scrape type 2
2026-01-28 20:21:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc with scrape type 2
2026-01-28 20:21:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc, identifier: 1877060
2026-01-28 20:21:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc with identifier: 1877060
2026-01-28 20:21:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc with identifier: 1877060
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'moondust silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit', 'trim': '2.0tdci 125kw trend 350e', 'title': 'ford transit 2.0tdci 125kw trend 350e', 'price': 0, 'odometer': 203561, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-16', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 2, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'ford transit', 'sanitized_make': 'ford', 'odometer_in_km': 203561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'moondust silver',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 2,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': 'ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit',
     'model': 'transit',
     'odometer': 203561,
     'odometer_in_km': 203561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-16',
     'sanitized_make': 'ford',
     'seats_number': 3,
     'seller_name': None,
     'title': 'ford transit 2.0tdci 125kw trend 350e',
     'transmission': 'manual',
     'trim': '2.0tdci 125kw trend 350e',
     'vin': None,
     'year': 2021}
2026-01-28 20:21:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc spider: ayvens.be
2026-01-28 20:21:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'moondust silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'transit', 'trim': '2.0tdci 125kw trend 350e', 'title': 'ford transit 2.0tdci 125kw trend 350e', 'price': 0, 'odometer': 203561, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-16', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 2, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': 0, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc', 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'ford transit', 'sanitized_make': 'ford', 'odometer_in_km': 203561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 52,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'color': 'moondust silver',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 2,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': 'ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford transit',
     'model': 'transit',
     'odometer': 203561,
     'odometer_in_km': 203561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-16',
     'sanitized_make': 'ford',
     'seats_number': 3,
     'seller_name': None,
     'title': 'ford transit 2.0tdci 125kw trend 350e',
     'transmission': 'manual',
     'trim': '2.0tdci 125kw trend 350e',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'MOONDUST SILVER',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ba5cbbc7-ef45-5bc3-b235-4e1191dbf1cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT',
 'odometer': 203561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2.0TDCI 125KW TREND 350E',
 'transmission': 'manual',
 'trim': '2.0TDCI 125KW TREND 350E',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877060%27 HTTP/1.1" 200 None
2026-01-28 20:21:39 [ayvens.be] INFO: Saving data for 1877060: {'auction_closing_time': 1770019200.0, 'created_time': 1769544807.94589, 'last_price_update_time': 1769631699.093004}
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877060') HTTP/1.1" 204 0
2026-01-28 20:21:39 [ayvens.be] INFO: Found listing with ID: 1877061
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877061%27 HTTP/1.1" 200 None
2026-01-28 20:21:39 [ayvens.be] INFO: Scrape type for 1877061: 2
2026-01-28 20:21:39 [ayvens.be] INFO: Extracting data for car ID: 1877061
2026-01-28 20:21:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849102d7-748a-57b2-bc59-369c53fa1766 with identifier: 1877061
2026-01-28 20:21:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849102d7-748a-57b2-bc59-369c53fa1766 with scrape type 2
2026-01-28 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849102d7-748a-57b2-bc59-369c53fa1766 with scrape type 2
2026-01-28 20:21:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 849102d7-748a-57b2-bc59-369c53fa1766, identifier: 1877061
2026-01-28 20:21:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 849102d7-748a-57b2-bc59-369c53fa1766 with identifier: 1877061
2026-01-28 20:21:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 849102d7-748a-57b2-bc59-369c53fa1766 with identifier: 1877061
2026-01-28 20:21:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 849102d7-748a-57b2-bc59-369c53fa1766 with identifier: 1877061 to the API
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'PLATINUM GREY METAALKLEUR',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '849102d7-748a-57b2-bc59-369c53fa1766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'Tiguan',
 'odometer': 115484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN Tiguan 1.5 TSI COMFORTLINE',
 'transmission': 'manual',
 'trim': '1.5 TSI COMFORTLINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877061%27 HTTP/1.1" 200 None
2026-01-28 20:21:39 [ayvens.be] INFO: Saving data for 1877061: {'auction_closing_time': 1770019200.0, 'created_time': 1769544805.453246, 'last_price_update_time': 1769631699.614447}
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877061') HTTP/1.1" 204 0
2026-01-28 20:21:39 [ayvens.be] INFO: Found listing with ID: 1877062
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877062%27 HTTP/1.1" 200 None
2026-01-28 20:21:39 [ayvens.be] INFO: Scrape type for 1877062: 2
2026-01-28 20:21:39 [ayvens.be] INFO: Extracting data for car ID: 1877062
2026-01-28 20:21:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2d2174-d564-5943-8550-9bf59604d1ed with identifier: 1877062
2026-01-28 20:21:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2d2174-d564-5943-8550-9bf59604d1ed with scrape type 2
2026-01-28 20:21:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2d2174-d564-5943-8550-9bf59604d1ed with scrape type 2
2026-01-28 20:21:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ec2d2174-d564-5943-8550-9bf59604d1ed, identifier: 1877062
2026-01-28 20:21:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ec2d2174-d564-5943-8550-9bf59604d1ed with identifier: 1877062
2026-01-28 20:21:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ec2d2174-d564-5943-8550-9bf59604d1ed with identifier: 1877062
2026-01-28 20:21:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ec2d2174-d564-5943-8550-9bf59604d1ed with identifier: 1877062 to the API
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'MIDNIGHT BLACK METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'ec2d2174-d564-5943-8550-9bf59604d1ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'ARONA',
 'odometer': 23166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT ARONA 1.0 TSI 70KW MOVE',
 'transmission': 'manual',
 'trim': '1.0 TSI 70KW MOVE',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877062%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Saving data for 1877062: {'auction_closing_time': 1770019200.0, 'created_time': 1769544811.782592, 'last_price_update_time': 1769631700.029988}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877062') HTTP/1.1" 204 0
2026-01-28 20:21:40 [ayvens.be] INFO: Found listing with ID: 1877063
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877063%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Scrape type for 1877063: 2
2026-01-28 20:21:40 [ayvens.be] INFO: Extracting data for car ID: 1877063
2026-01-28 20:21:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55be2241-f535-5d42-9343-f2e44c83b414 with identifier: 1877063
2026-01-28 20:21:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55be2241-f535-5d42-9343-f2e44c83b414 with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55be2241-f535-5d42-9343-f2e44c83b414 with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 55be2241-f535-5d42-9343-f2e44c83b414, identifier: 1877063
2026-01-28 20:21:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 55be2241-f535-5d42-9343-f2e44c83b414 with identifier: 1877063
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 55be2241-f535-5d42-9343-f2e44c83b414 with identifier: 1877063
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 55be2241-f535-5d42-9343-f2e44c83b414 spider: ayvens.be
2026-01-28 20:21:40 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 55be2241-f535-5d42-9343-f2e44c83b414 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '55be2241-f535-5d42-9343-f2e44c83b414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 76723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort (EU6)',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort (EU6)',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877063%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Saving data for 1877063: {'auction_closing_time': 1770019200.0, 'created_time': 1769544816.463163, 'last_price_update_time': 1769631700.362466}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877063') HTTP/1.1" 204 0
2026-01-28 20:21:40 [ayvens.be] INFO: Found listing with ID: 1877064
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877064%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Scrape type for 1877064: 2
2026-01-28 20:21:40 [ayvens.be] INFO: Extracting data for car ID: 1877064
2026-01-28 20:21:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf3787b-c1ec-5100-8100-5f7595118557 with identifier: 1877064
2026-01-28 20:21:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf3787b-c1ec-5100-8100-5f7595118557 with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cf3787b-c1ec-5100-8100-5f7595118557 with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0cf3787b-c1ec-5100-8100-5f7595118557, identifier: 1877064
2026-01-28 20:21:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0cf3787b-c1ec-5100-8100-5f7595118557 with identifier: 1877064
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0cf3787b-c1ec-5100-8100-5f7595118557 with identifier: 1877064
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 0cf3787b-c1ec-5100-8100-5f7595118557 spider: ayvens.be
2026-01-28 20:21:40 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0cf3787b-c1ec-5100-8100-5f7595118557 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0cf3787b-c1ec-5100-8100-5f7595118557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 94345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877064%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Saving data for 1877064: {'auction_closing_time': 1770019200.0, 'created_time': 1769544826.136395, 'last_price_update_time': 1769631700.699509}
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877064') HTTP/1.1" 204 0
2026-01-28 20:21:40 [ayvens.be] INFO: Found listing with ID: 1877065
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877065%27 HTTP/1.1" 200 None
2026-01-28 20:21:40 [ayvens.be] INFO: Scrape type for 1877065: 2
2026-01-28 20:21:40 [ayvens.be] INFO: Extracting data for car ID: 1877065
2026-01-28 20:21:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810ee815-938f-5ee7-947a-f0b584a4bb1b with identifier: 1877065
2026-01-28 20:21:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810ee815-938f-5ee7-947a-f0b584a4bb1b with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810ee815-938f-5ee7-947a-f0b584a4bb1b with scrape type 2
2026-01-28 20:21:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 810ee815-938f-5ee7-947a-f0b584a4bb1b, identifier: 1877065
2026-01-28 20:21:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 810ee815-938f-5ee7-947a-f0b584a4bb1b with identifier: 1877065
2026-01-28 20:21:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 810ee815-938f-5ee7-947a-f0b584a4bb1b with identifier: 1877065
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'bleu cavansite metal', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'vito', 'trim': '2.0 120kw 116 cdi lwb mixto l3', 'title': 'mercedes-benz vito 2.0 120kw 116 cdi lwb mixto l3', 'price': 0, 'odometer': 297834, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-10', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.9l', 'c_o_2_emission_value': 160, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '810ee815-938f-5ee7-947a-f0b584a4bb1b', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'mercedes-benz vito', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 297834}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 160,
     'color': 'bleu cavansite metal',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.9l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '810ee815-938f-5ee7-947a-f0b584a4bb1b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito',
     'model': 'vito',
     'odometer': 297834,
     'odometer_in_km': 297834,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-10',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 2,
     'seller_name': None,
     'title': 'mercedes-benz vito 2.0 120kw 116 cdi lwb mixto l3',
     'transmission': 'manual',
     'trim': '2.0 120kw 116 cdi lwb mixto l3',
     'vin': None,
     'year': 2021}
2026-01-28 20:21:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 810ee815-938f-5ee7-947a-f0b584a4bb1b spider: ayvens.be
2026-01-28 20:21:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 810ee815-938f-5ee7-947a-f0b584a4bb1b due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'bleu cavansite metal', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'mercedes-benz', 'model': 'vito', 'trim': '2.0 120kw 116 cdi lwb mixto l3', 'title': 'mercedes-benz vito 2.0 120kw 116 cdi lwb mixto l3', 'price': 0, 'odometer': 297834, 'odometer_reading_unit': 'km', 'registration_date': '2021-08-10', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '1.9l', 'c_o_2_emission_value': 160, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '810ee815-938f-5ee7-947a-f0b584a4bb1b', 'current_year_diff': 5, 'age_in_months': 53, 'make_model': 'mercedes-benz vito', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 297834}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 53,
     'auction_title': '',
     'c_o_2_emission_value': 160,
     'color': 'bleu cavansite metal',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 4,
     'engine': '1.9l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '810ee815-938f-5ee7-947a-f0b584a4bb1b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz vito',
     'model': 'vito',
     'odometer': 297834,
     'odometer_in_km': 297834,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-08-10',
     'sanitized_make': 'mercedesbenz',
     'seats_number': 2,
     'seller_name': None,
     'title': 'mercedes-benz vito 2.0 120kw 116 cdi lwb mixto l3',
     'transmission': 'manual',
     'trim': '2.0 120kw 116 cdi lwb mixto l3',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLEU CAVANSITE METAL',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.9L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '810ee815-938f-5ee7-947a-f0b584a4bb1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'Vito',
 'odometer': 297834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ Vito 2.0 120KW 116 CDI LWB MIXTO L3',
 'transmission': 'manual',
 'trim': '2.0 120KW 116 CDI LWB MIXTO L3',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877065%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Saving data for 1877065: {'auction_closing_time': 1770019200.0, 'created_time': 1769544825.893539, 'last_price_update_time': 1769631701.069725}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877065') HTTP/1.1" 204 0
2026-01-28 20:21:41 [ayvens.be] INFO: Found listing with ID: 1877066
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877066%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Scrape type for 1877066: 2
2026-01-28 20:21:41 [ayvens.be] INFO: Extracting data for car ID: 1877066
2026-01-28 20:21:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664f794f-a9d6-5f0d-9b12-819a497298da with identifier: 1877066
2026-01-28 20:21:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664f794f-a9d6-5f0d-9b12-819a497298da with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664f794f-a9d6-5f0d-9b12-819a497298da with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 664f794f-a9d6-5f0d-9b12-819a497298da, identifier: 1877066
2026-01-28 20:21:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 664f794f-a9d6-5f0d-9b12-819a497298da with identifier: 1877066
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 664f794f-a9d6-5f0d-9b12-819a497298da with identifier: 1877066
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 664f794f-a9d6-5f0d-9b12-819a497298da spider: ayvens.be
2026-01-28 20:21:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 664f794f-a9d6-5f0d-9b12-819a497298da due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '664f794f-a9d6-5f0d-9b12-819a497298da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877066%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Saving data for 1877066: {'auction_closing_time': 1770019200.0, 'created_time': 1769544833.590764, 'last_price_update_time': 1769631701.41713}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877066') HTTP/1.1" 204 0
2026-01-28 20:21:41 [ayvens.be] INFO: Found listing with ID: 1877067
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877067%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Scrape type for 1877067: 2
2026-01-28 20:21:41 [ayvens.be] INFO: Extracting data for car ID: 1877067
2026-01-28 20:21:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f4dee7-8c45-559d-836d-d1e55b809646 with identifier: 1877067
2026-01-28 20:21:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f4dee7-8c45-559d-836d-d1e55b809646 with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f4dee7-8c45-559d-836d-d1e55b809646 with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 23f4dee7-8c45-559d-836d-d1e55b809646, identifier: 1877067
2026-01-28 20:21:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 23f4dee7-8c45-559d-836d-d1e55b809646 with identifier: 1877067
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 23f4dee7-8c45-559d-836d-d1e55b809646 with identifier: 1877067
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23f4dee7-8c45-559d-836d-d1e55b809646 spider: ayvens.be
2026-01-28 20:21:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 23f4dee7-8c45-559d-836d-d1e55b809646 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '23f4dee7-8c45-559d-836d-d1e55b809646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 74779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877067%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Saving data for 1877067: {'auction_closing_time': 1770019200.0, 'created_time': 1769545132.363865, 'last_price_update_time': 1769631701.748906}
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877067') HTTP/1.1" 204 0
2026-01-28 20:21:41 [ayvens.be] INFO: Found listing with ID: 1877068
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877068%27 HTTP/1.1" 200 None
2026-01-28 20:21:41 [ayvens.be] INFO: Scrape type for 1877068: 2
2026-01-28 20:21:41 [ayvens.be] INFO: Extracting data for car ID: 1877068
2026-01-28 20:21:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with identifier: 1877068
2026-01-28 20:21:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with scrape type 2
2026-01-28 20:21:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fb89abc2-0aec-5d46-bdf0-003cdfb6da78, identifier: 1877068
2026-01-28 20:21:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with identifier: 1877068
2026-01-28 20:21:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with identifier: 1877068
2026-01-28 20:21:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fb89abc2-0aec-5d46-bdf0-003cdfb6da78 with identifier: 1877068 to the API
2026-01-28 20:21:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'fb89abc2-0aec-5d46-bdf0-003cdfb6da78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208',
 'odometer': 91670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 1.2 PURETECH E6.3 55KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.2 PURETECH E6.3 55KW S-S ACTIVE',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877068%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Saving data for 1877068: {'auction_closing_time': 1770019200.0, 'created_time': 1769545132.109022, 'last_price_update_time': 1769631702.133256}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877068') HTTP/1.1" 204 0
2026-01-28 20:21:42 [ayvens.be] INFO: Found listing with ID: 1877069
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877069%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Scrape type for 1877069: 2
2026-01-28 20:21:42 [ayvens.be] INFO: Extracting data for car ID: 1877069
2026-01-28 20:21:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 with identifier: 1877069
2026-01-28 20:21:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 with scrape type 2
2026-01-28 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 with scrape type 2
2026-01-28 20:21:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1, identifier: 1877069
2026-01-28 20:21:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 with identifier: 1877069
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 with identifier: 1877069
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146475 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146475
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 spider: ayvens.be
2026-01-28 20:21:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9381e9b3-8426-5d1d-b17f-dbfb216e03c1 due to rule: high_mileage_for_country.json, error: 146475 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146475
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '9381e9b3-8426-5d1d-b17f-dbfb216e03c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A3',
 'odometer': 146475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A3 40 TFSI Q Sport S tronic (EU6d-TEMP) STOCK',
 'transmission': 'automatic',
 'trim': '40 TFSI Q Sport S tronic (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877069%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Saving data for 1877069: {'auction_closing_time': 1770019200.0, 'created_time': 1769545127.607332, 'last_price_update_time': 1769631702.46393}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877069') HTTP/1.1" 204 0
2026-01-28 20:21:42 [ayvens.be] INFO: Found listing with ID: 1877070
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877070%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Scrape type for 1877070: 2
2026-01-28 20:21:42 [ayvens.be] INFO: Extracting data for car ID: 1877070
2026-01-28 20:21:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad01f891-3ffa-5463-b553-2064e45bc332 with identifier: 1877070
2026-01-28 20:21:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad01f891-3ffa-5463-b553-2064e45bc332 with scrape type 2
2026-01-28 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad01f891-3ffa-5463-b553-2064e45bc332 with scrape type 2
2026-01-28 20:21:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ad01f891-3ffa-5463-b553-2064e45bc332, identifier: 1877070
2026-01-28 20:21:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ad01f891-3ffa-5463-b553-2064e45bc332 with identifier: 1877070
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ad01f891-3ffa-5463-b553-2064e45bc332 with identifier: 1877070
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ad01f891-3ffa-5463-b553-2064e45bc332 spider: ayvens.be
2026-01-28 20:21:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ad01f891-3ffa-5463-b553-2064e45bc332 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ad01f891-3ffa-5463-b553-2064e45bc332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 74919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877070%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Saving data for 1877070: {'auction_closing_time': 1770019200.0, 'created_time': 1769545125.87982, 'last_price_update_time': 1769631702.878478}
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877070') HTTP/1.1" 204 0
2026-01-28 20:21:42 [ayvens.be] INFO: Found listing with ID: 1877071
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877071%27 HTTP/1.1" 200 None
2026-01-28 20:21:42 [ayvens.be] INFO: Scrape type for 1877071: 2
2026-01-28 20:21:42 [ayvens.be] INFO: Extracting data for car ID: 1877071
2026-01-28 20:21:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29fc10d3-60c7-5109-ad86-4d6554c63308 with identifier: 1877071
2026-01-28 20:21:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29fc10d3-60c7-5109-ad86-4d6554c63308 with scrape type 2
2026-01-28 20:21:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29fc10d3-60c7-5109-ad86-4d6554c63308 with scrape type 2
2026-01-28 20:21:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 29fc10d3-60c7-5109-ad86-4d6554c63308, identifier: 1877071
2026-01-28 20:21:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 29fc10d3-60c7-5109-ad86-4d6554c63308 with identifier: 1877071
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 29fc10d3-60c7-5109-ad86-4d6554c63308 with identifier: 1877071
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'trafic 29 fourgon swb dsl - 20' containing 'trafic'
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 29fc10d3-60c7-5109-ad86-4d6554c63308 spider: ayvens.be
2026-01-28 20:21:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 29fc10d3-60c7-5109-ad86-4d6554c63308 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'trafic 29 fourgon swb dsl - 20' containing 'trafic'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '29fc10d3-60c7-5109-ad86-4d6554c63308',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON SWB DSL - 20',
 'odometer': 118512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON SWB DSL - 20 1.6 dCi 29 L1H1 Grand '
          'Confort STOCK',
 'transmission': 'manual',
 'trim': '1.6 dCi 29 L1H1 Grand Confort STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877071%27 HTTP/1.1" 200 None
2026-01-28 20:21:43 [ayvens.be] INFO: Saving data for 1877071: {'auction_closing_time': 1770019200.0, 'created_time': 1769545123.888548, 'last_price_update_time': 1769631703.242132}
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877071') HTTP/1.1" 204 0
2026-01-28 20:21:43 [ayvens.be] INFO: Found listing with ID: 1877072
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877072%27 HTTP/1.1" 200 None
2026-01-28 20:21:43 [ayvens.be] INFO: Scrape type for 1877072: 2
2026-01-28 20:21:43 [ayvens.be] INFO: Extracting data for car ID: 1877072
2026-01-28 20:21:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb02de7-33e4-55b0-b91e-ccc8abffaca9 with identifier: 1877072
2026-01-28 20:21:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb02de7-33e4-55b0-b91e-ccc8abffaca9 with scrape type 2
2026-01-28 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb02de7-33e4-55b0-b91e-ccc8abffaca9 with scrape type 2
2026-01-28 20:21:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcb02de7-33e4-55b0-b91e-ccc8abffaca9, identifier: 1877072
2026-01-28 20:21:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcb02de7-33e4-55b0-b91e-ccc8abffaca9 with identifier: 1877072
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcb02de7-33e4-55b0-b91e-ccc8abffaca9 with identifier: 1877072
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175405 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    175405
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dcb02de7-33e4-55b0-b91e-ccc8abffaca9 spider: ayvens.be
2026-01-28 20:21:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: dcb02de7-33e4-55b0-b91e-ccc8abffaca9 due to rule: high_mileage_for_country.json, error: 175405 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    175405
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'dcb02de7-33e4-55b0-b91e-ccc8abffaca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'KUGA',
 'odometer': 175405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD KUGA 1.5 ECOBLUE 88KW TITANIUM AUTO',
 'transmission': 'automatic',
 'trim': '1.5 ECOBLUE 88KW TITANIUM AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877072%27 HTTP/1.1" 200 None
2026-01-28 20:21:43 [ayvens.be] INFO: Saving data for 1877072: {'auction_closing_time': 1770019200.0, 'created_time': 1769544869.361934, 'last_price_update_time': 1769631703.574291}
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877072') HTTP/1.1" 204 0
2026-01-28 20:21:43 [ayvens.be] INFO: Found listing with ID: 1877073
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877073%27 HTTP/1.1" 200 None
2026-01-28 20:21:43 [ayvens.be] INFO: Scrape type for 1877073: 2
2026-01-28 20:21:43 [ayvens.be] INFO: Extracting data for car ID: 1877073
2026-01-28 20:21:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with identifier: 1877073
2026-01-28 20:21:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with scrape type 2
2026-01-28 20:21:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with scrape type 2
2026-01-28 20:21:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9, identifier: 1877073
2026-01-28 20:21:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with identifier: 1877073
2026-01-28 20:21:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with identifier: 1877073
2026-01-28 20:21:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9 with identifier: 1877073 to the API
2026-01-28 20:21:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'e00aca04-50e2-5ee0-ac6c-30b86ecfd5c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'Focus',
 'odometer': 107113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD Focus 1.0I ECOBOOST 74KW CONNECTED',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST 74KW CONNECTED',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877073%27 HTTP/1.1" 200 None
2026-01-28 20:21:44 [ayvens.be] INFO: Saving data for 1877073: {'auction_closing_time': 1770019200.0, 'created_time': 1769544867.387722, 'last_price_update_time': 1769631704.655775}
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877073') HTTP/1.1" 204 0
2026-01-28 20:21:44 [ayvens.be] INFO: Found listing with ID: 1877074
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877074%27 HTTP/1.1" 200 None
2026-01-28 20:21:44 [ayvens.be] INFO: Scrape type for 1877074: 2
2026-01-28 20:21:44 [ayvens.be] INFO: Extracting data for car ID: 1877074
2026-01-28 20:21:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcd373e-b62a-584f-990d-426c47f19bfe with identifier: 1877074
2026-01-28 20:21:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcd373e-b62a-584f-990d-426c47f19bfe with scrape type 2
2026-01-28 20:21:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcd373e-b62a-584f-990d-426c47f19bfe with scrape type 2
2026-01-28 20:21:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1fcd373e-b62a-584f-990d-426c47f19bfe, identifier: 1877074
2026-01-28 20:21:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1fcd373e-b62a-584f-990d-426c47f19bfe with identifier: 1877074
2026-01-28 20:21:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1fcd373e-b62a-584f-990d-426c47f19bfe with identifier: 1877074
2026-01-28 20:21:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1fcd373e-b62a-584f-990d-426c47f19bfe spider: ayvens.be
2026-01-28 20:21:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 1fcd373e-b62a-584f-990d-426c47f19bfe due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '1fcd373e-b62a-584f-990d-426c47f19bfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 76576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877074%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Saving data for 1877074: {'auction_closing_time': 1770019200.0, 'created_time': 1769545121.100148, 'last_price_update_time': 1769631705.003526}
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877074') HTTP/1.1" 204 0
2026-01-28 20:21:45 [ayvens.be] INFO: Found listing with ID: 1877075
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877075%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Scrape type for 1877075: 2
2026-01-28 20:21:45 [ayvens.be] INFO: Extracting data for car ID: 1877075
2026-01-28 20:21:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd4c174-22a8-54f5-bffd-877476a08d8b with identifier: 1877075
2026-01-28 20:21:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd4c174-22a8-54f5-bffd-877476a08d8b with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd4c174-22a8-54f5-bffd-877476a08d8b with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dcd4c174-22a8-54f5-bffd-877476a08d8b, identifier: 1877075
2026-01-28 20:21:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dcd4c174-22a8-54f5-bffd-877476a08d8b with identifier: 1877075
2026-01-28 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dcd4c174-22a8-54f5-bffd-877476a08d8b with identifier: 1877075
2026-01-28 20:21:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: dcd4c174-22a8-54f5-bffd-877476a08d8b with identifier: 1877075 to the API
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '0.9L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'dcd4c174-22a8-54f5-bffd-877476a08d8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': '500C - 2015',
 'odometer': 109586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'FIAT 500C - 2015 0.9 T TwinAir Lounge (EU6d-TEMP) STOCK',
 'transmission': 'manual',
 'trim': '0.9 T TwinAir Lounge (EU6d-TEMP) STOCK',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877075%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Saving data for 1877075: {'auction_closing_time': 1770019200.0, 'created_time': 1769545117.136889, 'last_price_update_time': 1769631705.456623}
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877075') HTTP/1.1" 204 0
2026-01-28 20:21:45 [ayvens.be] INFO: Found listing with ID: 1877076
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877076%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Scrape type for 1877076: 2
2026-01-28 20:21:45 [ayvens.be] INFO: Extracting data for car ID: 1877076
2026-01-28 20:21:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6febe8b6-fa52-58d6-8b5f-137577987266 with identifier: 1877076
2026-01-28 20:21:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6febe8b6-fa52-58d6-8b5f-137577987266 with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6febe8b6-fa52-58d6-8b5f-137577987266 with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6febe8b6-fa52-58d6-8b5f-137577987266, identifier: 1877076
2026-01-28 20:21:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6febe8b6-fa52-58d6-8b5f-137577987266 with identifier: 1877076
2026-01-28 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6febe8b6-fa52-58d6-8b5f-137577987266 with identifier: 1877076
2026-01-28 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6febe8b6-fa52-58d6-8b5f-137577987266 spider: ayvens.be
2026-01-28 20:21:45 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 6febe8b6-fa52-58d6-8b5f-137577987266 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '6febe8b6-fa52-58d6-8b5f-137577987266',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 51202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877076%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Saving data for 1877076: {'auction_closing_time': 1770019200.0, 'created_time': 1769545115.212939, 'last_price_update_time': 1769631705.803911}
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877076') HTTP/1.1" 204 0
2026-01-28 20:21:45 [ayvens.be] INFO: Found listing with ID: 1877077
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877077%27 HTTP/1.1" 200 None
2026-01-28 20:21:45 [ayvens.be] INFO: Scrape type for 1877077: 2
2026-01-28 20:21:45 [ayvens.be] INFO: Extracting data for car ID: 1877077
2026-01-28 20:21:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with identifier: 1877077
2026-01-28 20:21:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with scrape type 2
2026-01-28 20:21:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d14c800a-2bea-5c4d-ab1d-aca3e005a5a0, identifier: 1877077
2026-01-28 20:21:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with identifier: 1877077
2026-01-28 20:21:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with identifier: 1877077
2026-01-28 20:21:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d14c800a-2bea-5c4d-ab1d-aca3e005a5a0 with identifier: 1877077 to the API
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'LAVA BLUE METALLIC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd14c800a-2bea-5c4d-ab1d-aca3e005a5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI',
 'odometer': 101529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI 2.0 CRTDI 85KW AMBITION',
 'transmission': 'manual',
 'trim': '2.0 CRTDI 85KW AMBITION',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877077%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Saving data for 1877077: {'auction_closing_time': 1770019200.0, 'created_time': 1769544893.420529, 'last_price_update_time': 1769631706.230566}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877077') HTTP/1.1" 204 0
2026-01-28 20:21:46 [ayvens.be] INFO: Found listing with ID: 1877078
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877078%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Scrape type for 1877078: 2
2026-01-28 20:21:46 [ayvens.be] INFO: Extracting data for car ID: 1877078
2026-01-28 20:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afa7000-c0ad-5718-bbc0-c258382a7312 with identifier: 1877078
2026-01-28 20:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afa7000-c0ad-5718-bbc0-c258382a7312 with scrape type 2
2026-01-28 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2afa7000-c0ad-5718-bbc0-c258382a7312 with scrape type 2
2026-01-28 20:21:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2afa7000-c0ad-5718-bbc0-c258382a7312, identifier: 1877078
2026-01-28 20:21:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2afa7000-c0ad-5718-bbc0-c258382a7312 with identifier: 1877078
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2afa7000-c0ad-5718-bbc0-c258382a7312 with identifier: 1877078
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174131 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    174131
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2afa7000-c0ad-5718-bbc0-c258382a7312 spider: ayvens.be
2026-01-28 20:21:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2afa7000-c0ad-5718-bbc0-c258382a7312 due to rule: high_mileage_for_country.json, error: 174131 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    174131
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '2afa7000-c0ad-5718-bbc0-c258382a7312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2 DIESEL',
 'odometer': 174131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 DIESEL 1.5 dA sDrive16',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877078%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Saving data for 1877078: {'auction_closing_time': 1770019200.0, 'created_time': 1769544891.98532, 'last_price_update_time': 1769631706.565397}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877078') HTTP/1.1" 204 0
2026-01-28 20:21:46 [ayvens.be] INFO: Found listing with ID: 1877079
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877079%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Scrape type for 1877079: 2
2026-01-28 20:21:46 [ayvens.be] INFO: Extracting data for car ID: 1877079
2026-01-28 20:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 with identifier: 1877079
2026-01-28 20:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 with scrape type 2
2026-01-28 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 with scrape type 2
2026-01-28 20:21:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4, identifier: 1877079
2026-01-28 20:21:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 with identifier: 1877079
2026-01-28 20:21:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 with identifier: 1877079
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182232 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    182232
2026-01-28 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 spider: ayvens.be
2026-01-28 20:21:46 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3db6e380-3cfb-5b25-ae88-46c458d5b1d4 due to rule: high_mileage_for_country.json, error: 182232 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    182232
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'PURE WHITE NON',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '3db6e380-3cfb-5b25-ae88-46c458d5b1d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT VARIANT',
 'odometer': 182232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT VARIANT 2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'transmission': 'automatic',
 'trim': '2.0 TDI 90KW MSQ VARIANT STYLE BUSINESS',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877079%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Saving data for 1877079: {'auction_closing_time': 1770019200.0, 'created_time': 1769544896.18851, 'last_price_update_time': 1769631706.896268}
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877079') HTTP/1.1" 204 0
2026-01-28 20:21:46 [ayvens.be] INFO: Found listing with ID: 1877080
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877080%27 HTTP/1.1" 200 None
2026-01-28 20:21:46 [ayvens.be] INFO: Scrape type for 1877080: 2
2026-01-28 20:21:46 [ayvens.be] INFO: Extracting data for car ID: 1877080
2026-01-28 20:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0127adf6-b358-5ece-8239-220aa83f4091 with identifier: 1877080
2026-01-28 20:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0127adf6-b358-5ece-8239-220aa83f4091 with scrape type 2
2026-01-28 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0127adf6-b358-5ece-8239-220aa83f4091 with scrape type 2
2026-01-28 20:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0127adf6-b358-5ece-8239-220aa83f4091, identifier: 1877080
2026-01-28 20:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0127adf6-b358-5ece-8239-220aa83f4091 with identifier: 1877080
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0127adf6-b358-5ece-8239-220aa83f4091 with identifier: 1877080
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'tourneo courier', 'trim': '1.5 tdci 75kw titanium', 'title': 'ford tourneo courier 1.5 tdci 75kw titanium', 'price': 0, 'odometer': 229189, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-10', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 146, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0127adf6-b358-5ece-8239-220aa83f4091', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'ford tourneo courier', 'sanitized_make': 'ford', 'odometer_in_km': 229189}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '0127adf6-b358-5ece-8239-220aa83f4091',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford tourneo courier',
     'model': 'tourneo courier',
     'odometer': 229189,
     'odometer_in_km': 229189,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-10',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford tourneo courier 1.5 tdci 75kw titanium',
     'transmission': 'manual',
     'trim': '1.5 tdci 75kw titanium',
     'vin': None,
     'year': 2020}
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0127adf6-b358-5ece-8239-220aa83f4091 spider: ayvens.be
2026-01-28 20:21:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0127adf6-b358-5ece-8239-220aa83f4091 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'ford', 'model': 'tourneo courier', 'trim': '1.5 tdci 75kw titanium', 'title': 'ford tourneo courier 1.5 tdci 75kw titanium', 'price': 0, 'odometer': 229189, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-10', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': 146, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0127adf6-b358-5ece-8239-220aa83f4091', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'ford tourneo courier', 'sanitized_make': 'ford', 'odometer_in_km': 229189}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '0127adf6-b358-5ece-8239-220aa83f4091',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'ford',
     'make_model': 'ford tourneo courier',
     'model': 'tourneo courier',
     'odometer': 229189,
     'odometer_in_km': 229189,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-10',
     'sanitized_make': 'ford',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ford tourneo courier 1.5 tdci 75kw titanium',
     'transmission': 'manual',
     'trim': '1.5 tdci 75kw titanium',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0127adf6-b358-5ece-8239-220aa83f4091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TOURNEO COURIER',
 'odometer': 229189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD TOURNEO COURIER 1.5 TDCI 75KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.5 TDCI 75KW TITANIUM',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877080%27 HTTP/1.1" 200 None
2026-01-28 20:21:47 [ayvens.be] INFO: Saving data for 1877080: {'auction_closing_time': 1770019200.0, 'created_time': 1769545112.001452, 'last_price_update_time': 1769631707.230589}
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877080') HTTP/1.1" 204 0
2026-01-28 20:21:47 [ayvens.be] INFO: Found listing with ID: 1877081
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877081%27 HTTP/1.1" 200 None
2026-01-28 20:21:47 [ayvens.be] INFO: Scrape type for 1877081: 2
2026-01-28 20:21:47 [ayvens.be] INFO: Extracting data for car ID: 1877081
2026-01-28 20:21:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 622154f9-5806-5aea-8c56-eeb366cb00cc with identifier: 1877081
2026-01-28 20:21:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 622154f9-5806-5aea-8c56-eeb366cb00cc with scrape type 2
2026-01-28 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 622154f9-5806-5aea-8c56-eeb366cb00cc with scrape type 2
2026-01-28 20:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 622154f9-5806-5aea-8c56-eeb366cb00cc, identifier: 1877081
2026-01-28 20:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 622154f9-5806-5aea-8c56-eeb366cb00cc with identifier: 1877081
2026-01-28 20:21:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 622154f9-5806-5aea-8c56-eeb366cb00cc with identifier: 1877081
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162512 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    162512
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 622154f9-5806-5aea-8c56-eeb366cb00cc spider: ayvens.be
2026-01-28 20:21:47 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 622154f9-5806-5aea-8c56-eeb366cb00cc due to rule: high_mileage_for_country.json, error: 162512 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    162512
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'AMETHYST PURPLE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '622154f9-5806-5aea-8c56-eeb366cb00cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'GRANDLAND X DIESEL',
 'odometer': 162512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'OPEL GRANDLAND X DIESEL 1.5 Turbo ECOTEC D Innovation (EU6.2) STOCK',
 'transmission': 'manual',
 'trim': '1.5 Turbo ECOTEC D Innovation (EU6.2) STOCK',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877081%27 HTTP/1.1" 200 None
2026-01-28 20:21:47 [ayvens.be] INFO: Saving data for 1877081: {'auction_closing_time': 1770019200.0, 'created_time': 1769545110.255447, 'last_price_update_time': 1769631707.746548}
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877081') HTTP/1.1" 204 0
2026-01-28 20:21:47 [ayvens.be] INFO: Found listing with ID: 1877082
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877082%27 HTTP/1.1" 200 None
2026-01-28 20:21:47 [ayvens.be] INFO: Scrape type for 1877082: 2
2026-01-28 20:21:47 [ayvens.be] INFO: Extracting data for car ID: 1877082
2026-01-28 20:21:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 with identifier: 1877082
2026-01-28 20:21:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 with scrape type 2
2026-01-28 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 with scrape type 2
2026-01-28 20:21:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57, identifier: 1877082
2026-01-28 20:21:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 with identifier: 1877082
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 with identifier: 1877082
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:21:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 spider: ayvens.be
2026-01-28 20:21:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '2e4a3122-6cdc-5f2a-9e6d-b0d56d944f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 64947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort (EU6)',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort (EU6)',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877082%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Saving data for 1877082: {'auction_closing_time': 1770019200.0, 'created_time': 1769544909.929894, 'last_price_update_time': 1769631708.090699}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877082') HTTP/1.1" 204 0
2026-01-28 20:21:48 [ayvens.be] INFO: Found listing with ID: 1877083
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877083%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Scrape type for 1877083: 2
2026-01-28 20:21:48 [ayvens.be] INFO: Extracting data for car ID: 1877083
2026-01-28 20:21:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5c77780-f342-5856-b916-22866e62ebf1 with identifier: 1877083
2026-01-28 20:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c77780-f342-5856-b916-22866e62ebf1 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5c77780-f342-5856-b916-22866e62ebf1 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e5c77780-f342-5856-b916-22866e62ebf1, identifier: 1877083
2026-01-28 20:21:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e5c77780-f342-5856-b916-22866e62ebf1 with identifier: 1877083
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e5c77780-f342-5856-b916-22866e62ebf1 with identifier: 1877083
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e5c77780-f342-5856-b916-22866e62ebf1 spider: ayvens.be
2026-01-28 20:21:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: e5c77780-f342-5856-b916-22866e62ebf1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'e5c77780-f342-5856-b916-22866e62ebf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'PARTNER',
 'odometer': 84108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'PEUGEOT PARTNER 1.5 BHDI L2 HEAVY 75KW PRO',
 'transmission': 'manual',
 'trim': '1.5 BHDI L2 HEAVY 75KW PRO',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877083%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Saving data for 1877083: {'auction_closing_time': 1770019200.0, 'created_time': 1769545107.705765, 'last_price_update_time': 1769631708.408474}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877083') HTTP/1.1" 204 0
2026-01-28 20:21:48 [ayvens.be] INFO: Found listing with ID: 1877084
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877084%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Scrape type for 1877084: 2
2026-01-28 20:21:48 [ayvens.be] INFO: Extracting data for car ID: 1877084
2026-01-28 20:21:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 with identifier: 1877084
2026-01-28 20:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0, identifier: 1877084
2026-01-28 20:21:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 with identifier: 1877084
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 with identifier: 1877084
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 spider: ayvens.be
2026-01-28 20:21:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d5f5e0c5-1ccc-5e25-a2be-a806f537d5b0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'd5f5e0c5-1ccc-5e25-a2be-a806f537d5b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 66535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877084%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Saving data for 1877084: {'auction_closing_time': 1770019200.0, 'created_time': 1769545106.142126, 'last_price_update_time': 1769631708.790856}
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877084') HTTP/1.1" 204 0
2026-01-28 20:21:48 [ayvens.be] INFO: Found listing with ID: 1877085
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877085%27 HTTP/1.1" 200 None
2026-01-28 20:21:48 [ayvens.be] INFO: Scrape type for 1877085: 2
2026-01-28 20:21:48 [ayvens.be] INFO: Extracting data for car ID: 1877085
2026-01-28 20:21:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f64861-9e96-50f6-903a-45fa50993477 with identifier: 1877085
2026-01-28 20:21:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f64861-9e96-50f6-903a-45fa50993477 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f64861-9e96-50f6-903a-45fa50993477 with scrape type 2
2026-01-28 20:21:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 88f64861-9e96-50f6-903a-45fa50993477, identifier: 1877085
2026-01-28 20:21:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 88f64861-9e96-50f6-903a-45fa50993477 with identifier: 1877085
2026-01-28 20:21:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 88f64861-9e96-50f6-903a-45fa50993477 with identifier: 1877085
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 88f64861-9e96-50f6-903a-45fa50993477 spider: ayvens.be
2026-01-28 20:21:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 88f64861-9e96-50f6-903a-45fa50993477 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '88f64861-9e96-50f6-903a-45fa50993477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 64342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-08',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 3.1T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 3.1T',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877085%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Saving data for 1877085: {'auction_closing_time': 1770019200.0, 'created_time': 1769545105.913062, 'last_price_update_time': 1769631709.129432}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877085') HTTP/1.1" 204 0
2026-01-28 20:21:49 [ayvens.be] INFO: Found listing with ID: 1877086
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877086%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Scrape type for 1877086: 2
2026-01-28 20:21:49 [ayvens.be] INFO: Extracting data for car ID: 1877086
2026-01-28 20:21:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d with identifier: 1877086
2026-01-28 20:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e426ce1-d808-59fe-bfb0-1dcd2eea346d with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e426ce1-d808-59fe-bfb0-1dcd2eea346d with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d, identifier: 1877086
2026-01-28 20:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d with identifier: 1877086
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d with identifier: 1877086
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148271 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148271
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d spider: ayvens.be
2026-01-28 20:21:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 7e426ce1-d808-59fe-bfb0-1dcd2eea346d due to rule: high_mileage_for_country.json, error: 148271 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148271
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '7e426ce1-d808-59fe-bfb0-1dcd2eea346d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'MEGANE GRANDTOUR DIESEL - 2016',
 'odometer': 148271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT MEGANE GRANDTOUR DIESEL - 2016 1.5 Blue dCi Intens',
 'transmission': 'manual',
 'trim': '1.5 Blue dCi Intens',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877086%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Saving data for 1877086: {'auction_closing_time': 1770019200.0, 'created_time': 1769545101.645462, 'last_price_update_time': 1769631709.451139}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877086') HTTP/1.1" 204 0
2026-01-28 20:21:49 [ayvens.be] INFO: Found listing with ID: 1877087
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877087%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Scrape type for 1877087: 2
2026-01-28 20:21:49 [ayvens.be] INFO: Extracting data for car ID: 1877087
2026-01-28 20:21:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc4def1-b8da-5463-b2d0-c0e3636228cf with identifier: 1877087
2026-01-28 20:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc4def1-b8da-5463-b2d0-c0e3636228cf with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc4def1-b8da-5463-b2d0-c0e3636228cf with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4dc4def1-b8da-5463-b2d0-c0e3636228cf, identifier: 1877087
2026-01-28 20:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4dc4def1-b8da-5463-b2d0-c0e3636228cf with identifier: 1877087
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4dc4def1-b8da-5463-b2d0-c0e3636228cf with identifier: 1877087
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161195 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    161195
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4dc4def1-b8da-5463-b2d0-c0e3636228cf spider: ayvens.be
2026-01-28 20:21:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4dc4def1-b8da-5463-b2d0-c0e3636228cf due to rule: high_mileage_for_country.json, error: 161195 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    161195
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '4dc4def1-b8da-5463-b2d0-c0e3636228cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA COMBI DIESEL - 2020',
 'odometer': 161195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA COMBI DIESEL - 2020 2.0 CR TDi EVO Ambition',
 'transmission': 'manual',
 'trim': '2.0 CR TDi EVO Ambition',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877087%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Saving data for 1877087: {'auction_closing_time': 1770019200.0, 'created_time': 1769545098.887552, 'last_price_update_time': 1769631709.796586}
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877087') HTTP/1.1" 204 0
2026-01-28 20:21:49 [ayvens.be] INFO: Found listing with ID: 1877088
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877088%27 HTTP/1.1" 200 None
2026-01-28 20:21:49 [ayvens.be] INFO: Scrape type for 1877088: 2
2026-01-28 20:21:49 [ayvens.be] INFO: Extracting data for car ID: 1877088
2026-01-28 20:21:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e6115e-16d0-5c7d-8a7e-cd06305689c1 with identifier: 1877088
2026-01-28 20:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e6115e-16d0-5c7d-8a7e-cd06305689c1 with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e6115e-16d0-5c7d-8a7e-cd06305689c1 with scrape type 2
2026-01-28 20:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b5e6115e-16d0-5c7d-8a7e-cd06305689c1, identifier: 1877088
2026-01-28 20:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b5e6115e-16d0-5c7d-8a7e-cd06305689c1 with identifier: 1877088
2026-01-28 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b5e6115e-16d0-5c7d-8a7e-cd06305689c1 with identifier: 1877088
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148240 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148240
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b5e6115e-16d0-5c7d-8a7e-cd06305689c1 spider: ayvens.be
2026-01-28 20:21:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b5e6115e-16d0-5c7d-8a7e-cd06305689c1 due to rule: high_mileage_for_country.json, error: 148240 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148240
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'b5e6115e-16d0-5c7d-8a7e-cd06305689c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 148240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16DA',
 'transmission': 'automatic',
 'trim': '1.5 SDRIVE16DA',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877088%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Saving data for 1877088: {'auction_closing_time': 1770019200.0, 'created_time': 1769545095.69145, 'last_price_update_time': 1769631710.196253}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877088') HTTP/1.1" 204 0
2026-01-28 20:21:50 [ayvens.be] INFO: Found listing with ID: 1877089
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877089%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Scrape type for 1877089: 2
2026-01-28 20:21:50 [ayvens.be] INFO: Extracting data for car ID: 1877089
2026-01-28 20:21:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f2254be-e268-51ff-85c6-3881daab188d with identifier: 1877089
2026-01-28 20:21:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f2254be-e268-51ff-85c6-3881daab188d with scrape type 2
2026-01-28 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f2254be-e268-51ff-85c6-3881daab188d with scrape type 2
2026-01-28 20:21:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f2254be-e268-51ff-85c6-3881daab188d, identifier: 1877089
2026-01-28 20:21:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f2254be-e268-51ff-85c6-3881daab188d with identifier: 1877089
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f2254be-e268-51ff-85c6-3881daab188d with identifier: 1877089
2026-01-28 20:21:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 0f2254be-e268-51ff-85c6-3881daab188d with identifier: 1877089 to the API
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f2254be-e268-51ff-85c6-3881daab188d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 108089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S BUSINESS GPS '
          'AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S BUSINESS GPS AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877089%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Saving data for 1877089: {'auction_closing_time': 1770019200.0, 'created_time': 1769545090.721277, 'last_price_update_time': 1769631710.583917}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877089') HTTP/1.1" 204 0
2026-01-28 20:21:50 [ayvens.be] INFO: Found listing with ID: 1877090
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877090%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Scrape type for 1877090: 2
2026-01-28 20:21:50 [ayvens.be] INFO: Extracting data for car ID: 1877090
2026-01-28 20:21:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ae627f-7c84-575a-ae16-cd87470aa5ba with identifier: 1877090
2026-01-28 20:21:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ae627f-7c84-575a-ae16-cd87470aa5ba with scrape type 2
2026-01-28 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91ae627f-7c84-575a-ae16-cd87470aa5ba with scrape type 2
2026-01-28 20:21:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 91ae627f-7c84-575a-ae16-cd87470aa5ba, identifier: 1877090
2026-01-28 20:21:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 91ae627f-7c84-575a-ae16-cd87470aa5ba with identifier: 1877090
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 91ae627f-7c84-575a-ae16-cd87470aa5ba with identifier: 1877090
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 91ae627f-7c84-575a-ae16-cd87470aa5ba spider: ayvens.be
2026-01-28 20:21:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 91ae627f-7c84-575a-ae16-cd87470aa5ba due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '91ae627f-7c84-575a-ae16-cd87470aa5ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 136473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 80 GRAND CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 80 GRAND CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877090%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Saving data for 1877090: {'auction_closing_time': 1770019200.0, 'created_time': 1769545088.400327, 'last_price_update_time': 1769631710.910927}
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877090') HTTP/1.1" 204 0
2026-01-28 20:21:50 [ayvens.be] INFO: Found listing with ID: 1877091
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877091%27 HTTP/1.1" 200 None
2026-01-28 20:21:50 [ayvens.be] INFO: Scrape type for 1877091: 2
2026-01-28 20:21:50 [ayvens.be] INFO: Extracting data for car ID: 1877091
2026-01-28 20:21:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87cb8944-8199-5467-8c32-b28ceec92852 with identifier: 1877091
2026-01-28 20:21:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87cb8944-8199-5467-8c32-b28ceec92852 with scrape type 2
2026-01-28 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87cb8944-8199-5467-8c32-b28ceec92852 with scrape type 2
2026-01-28 20:21:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 87cb8944-8199-5467-8c32-b28ceec92852, identifier: 1877091
2026-01-28 20:21:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 87cb8944-8199-5467-8c32-b28ceec92852 with identifier: 1877091
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 87cb8944-8199-5467-8c32-b28ceec92852 with identifier: 1877091
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato 35 fourgon lwb dsl - 20' containing 'ducato'
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 87cb8944-8199-5467-8c32-b28ceec92852 spider: ayvens.be
2026-01-28 20:21:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 87cb8944-8199-5467-8c32-b28ceec92852 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato 35 fourgon lwb dsl - 20' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLANC',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '87cb8944-8199-5467-8c32-b28ceec92852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FIAT',
 'model': 'DUCATO 35 FOURGON LWB DSL - 20',
 'odometer': 179932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seats_number': None,
 'seller_name': None,
 'title': 'FIAT DUCATO 35 FOURGON LWB DSL - 20 2.0 Mjet L3H2 (EU6)',
 'transmission': 'manual',
 'trim': '2.0 Mjet L3H2 (EU6)',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877091%27 HTTP/1.1" 200 None
2026-01-28 20:21:51 [ayvens.be] INFO: Saving data for 1877091: {'auction_closing_time': 1770019200.0, 'created_time': 1769544959.283118, 'last_price_update_time': 1769631711.276773}
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877091') HTTP/1.1" 204 0
2026-01-28 20:21:51 [ayvens.be] INFO: Found listing with ID: 1877092
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877092%27 HTTP/1.1" 200 None
2026-01-28 20:21:51 [ayvens.be] INFO: Scrape type for 1877092: 2
2026-01-28 20:21:51 [ayvens.be] INFO: Extracting data for car ID: 1877092
2026-01-28 20:21:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65659d2-008c-576c-8946-c948cc4ac609 with identifier: 1877092
2026-01-28 20:21:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65659d2-008c-576c-8946-c948cc4ac609 with scrape type 2
2026-01-28 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65659d2-008c-576c-8946-c948cc4ac609 with scrape type 2
2026-01-28 20:21:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d65659d2-008c-576c-8946-c948cc4ac609, identifier: 1877092
2026-01-28 20:21:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d65659d2-008c-576c-8946-c948cc4ac609 with identifier: 1877092
2026-01-28 20:21:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d65659d2-008c-576c-8946-c948cc4ac609 with identifier: 1877092
2026-01-28 20:21:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d65659d2-008c-576c-8946-c948cc4ac609 with identifier: 1877092 to the API
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'MINERALWEISS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': 'd65659d2-008c-576c-8946-c948cc4ac609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 54418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877092%27 HTTP/1.1" 200 None
2026-01-28 20:21:51 [ayvens.be] INFO: Saving data for 1877092: {'auction_closing_time': 1770019200.0, 'created_time': 1769544956.666879, 'last_price_update_time': 1769631711.75463}
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877092') HTTP/1.1" 204 0
2026-01-28 20:21:51 [ayvens.be] INFO: Found listing with ID: 1877093
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877093%27 HTTP/1.1" 200 None
2026-01-28 20:21:51 [ayvens.be] INFO: Scrape type for 1877093: 2
2026-01-28 20:21:51 [ayvens.be] INFO: Extracting data for car ID: 1877093
2026-01-28 20:21:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2a377e-2578-504f-8a33-9524f8c8c665 with identifier: 1877093
2026-01-28 20:21:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2a377e-2578-504f-8a33-9524f8c8c665 with scrape type 2
2026-01-28 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef2a377e-2578-504f-8a33-9524f8c8c665 with scrape type 2
2026-01-28 20:21:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ef2a377e-2578-504f-8a33-9524f8c8c665, identifier: 1877093
2026-01-28 20:21:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ef2a377e-2578-504f-8a33-9524f8c8c665 with identifier: 1877093
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ef2a377e-2578-504f-8a33-9524f8c8c665 with identifier: 1877093
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ef2a377e-2578-504f-8a33-9524f8c8c665 spider: ayvens.be
2026-01-28 20:21:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ef2a377e-2578-504f-8a33-9524f8c8c665 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ef2a377e-2578-504f-8a33-9524f8c8c665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 76791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 CONFORT',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877093%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Saving data for 1877093: {'auction_closing_time': 1770019200.0, 'created_time': 1769544966.252519, 'last_price_update_time': 1769631712.09039}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877093') HTTP/1.1" 204 0
2026-01-28 20:21:52 [ayvens.be] INFO: Found listing with ID: 1877094
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877094%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Scrape type for 1877094: 2
2026-01-28 20:21:52 [ayvens.be] INFO: Extracting data for car ID: 1877094
2026-01-28 20:21:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 with identifier: 1877094
2026-01-28 20:21:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68, identifier: 1877094
2026-01-28 20:21:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 with identifier: 1877094
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 with identifier: 1877094
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158689 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    158689
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 spider: ayvens.be
2026-01-28 20:21:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a8c0e8c0-d4f4-5293-857b-5ba99b13cc68 due to rule: high_mileage_for_country.json, error: 158689 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    158689
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a8c0e8c0-d4f4-5293-857b-5ba99b13cc68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 158689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 M LIGHT CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 M LIGHT CLUB',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877094%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Saving data for 1877094: {'auction_closing_time': 1770019200.0, 'created_time': 1769545086.711614, 'last_price_update_time': 1769631712.4268}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877094') HTTP/1.1" 204 0
2026-01-28 20:21:52 [ayvens.be] INFO: Found listing with ID: 1877095
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877095%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Scrape type for 1877095: 2
2026-01-28 20:21:52 [ayvens.be] INFO: Extracting data for car ID: 1877095
2026-01-28 20:21:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20157c5e-d59e-5359-b0ac-5ca6461283ff with identifier: 1877095
2026-01-28 20:21:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20157c5e-d59e-5359-b0ac-5ca6461283ff with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20157c5e-d59e-5359-b0ac-5ca6461283ff with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 20157c5e-d59e-5359-b0ac-5ca6461283ff, identifier: 1877095
2026-01-28 20:21:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 20157c5e-d59e-5359-b0ac-5ca6461283ff with identifier: 1877095
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 20157c5e-d59e-5359-b0ac-5ca6461283ff with identifier: 1877095
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 20157c5e-d59e-5359-b0ac-5ca6461283ff spider: ayvens.be
2026-01-28 20:21:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 20157c5e-d59e-5359-b0ac-5ca6461283ff due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.7L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '20157c5e-d59e-5359-b0ac-5ca6461283ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'VITO',
 'odometer': 112290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MERCEDES-BENZ VITO 1.7 75KW 110 CDI FWD MIXTO L2',
 'transmission': 'manual',
 'trim': '1.7 75KW 110 CDI FWD MIXTO L2',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877095%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Saving data for 1877095: {'auction_closing_time': 1770019200.0, 'created_time': 1769545083.537335, 'last_price_update_time': 1769631712.776573}
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877095') HTTP/1.1" 204 0
2026-01-28 20:21:52 [ayvens.be] INFO: Found listing with ID: 1877096
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877096%27 HTTP/1.1" 200 None
2026-01-28 20:21:52 [ayvens.be] INFO: Scrape type for 1877096: 2
2026-01-28 20:21:52 [ayvens.be] INFO: Extracting data for car ID: 1877096
2026-01-28 20:21:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc14242-066c-500c-86c0-765f5b328fa3 with identifier: 1877096
2026-01-28 20:21:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc14242-066c-500c-86c0-765f5b328fa3 with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc14242-066c-500c-86c0-765f5b328fa3 with scrape type 2
2026-01-28 20:21:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bfc14242-066c-500c-86c0-765f5b328fa3, identifier: 1877096
2026-01-28 20:21:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bfc14242-066c-500c-86c0-765f5b328fa3 with identifier: 1877096
2026-01-28 20:21:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bfc14242-066c-500c-86c0-765f5b328fa3 with identifier: 1877096
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144360 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    144360
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bfc14242-066c-500c-86c0-765f5b328fa3 spider: ayvens.be
2026-01-28 20:21:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: bfc14242-066c-500c-86c0-765f5b328fa3 due to rule: high_mileage_for_country.json, error: 144360 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    144360
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'bfc14242-066c-500c-86c0-765f5b328fa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS CLIPPER DIESEL - 2018',
 'odometer': 144360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS CLIPPER DIESEL - 2018 1.5 EcoBlue Titanium Business',
 'transmission': 'automatic',
 'trim': '1.5 EcoBlue Titanium Business',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877096%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Saving data for 1877096: {'auction_closing_time': 1770019200.0, 'created_time': 1769545078.025994, 'last_price_update_time': 1769631713.144224}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877096') HTTP/1.1" 204 0
2026-01-28 20:21:53 [ayvens.be] INFO: Found listing with ID: 1877097
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877097%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Scrape type for 1877097: 2
2026-01-28 20:21:53 [ayvens.be] INFO: Extracting data for car ID: 1877097
2026-01-28 20:21:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a36aefef-ff8f-5535-9df0-925b864c2805 with identifier: 1877097
2026-01-28 20:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a36aefef-ff8f-5535-9df0-925b864c2805 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a36aefef-ff8f-5535-9df0-925b864c2805 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a36aefef-ff8f-5535-9df0-925b864c2805, identifier: 1877097
2026-01-28 20:21:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a36aefef-ff8f-5535-9df0-925b864c2805 with identifier: 1877097
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a36aefef-ff8f-5535-9df0-925b864c2805 with identifier: 1877097
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163245 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    163245
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a36aefef-ff8f-5535-9df0-925b864c2805 spider: ayvens.be
2026-01-28 20:21:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a36aefef-ff8f-5535-9df0-925b864c2805 due to rule: high_mileage_for_country.json, error: 163245 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    163245
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'a36aefef-ff8f-5535-9df0-925b864c2805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 163245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.5 BLUEHDI 96KW S-S AUTO GT',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO GT',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877097%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Saving data for 1877097: {'auction_closing_time': 1770019200.0, 'created_time': 1769545075.346312, 'last_price_update_time': 1769631713.483445}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877097') HTTP/1.1" 204 0
2026-01-28 20:21:53 [ayvens.be] INFO: Found listing with ID: 1877098
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877098%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Scrape type for 1877098: 2
2026-01-28 20:21:53 [ayvens.be] INFO: Extracting data for car ID: 1877098
2026-01-28 20:21:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a667758-de5b-5e96-b2f3-560b6883bf77 with identifier: 1877098
2026-01-28 20:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a667758-de5b-5e96-b2f3-560b6883bf77 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a667758-de5b-5e96-b2f3-560b6883bf77 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7a667758-de5b-5e96-b2f3-560b6883bf77, identifier: 1877098
2026-01-28 20:21:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7a667758-de5b-5e96-b2f3-560b6883bf77 with identifier: 1877098
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7a667758-de5b-5e96-b2f3-560b6883bf77 with identifier: 1877098
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'trafic 29 fourgon mwb dsl - 20', 'trim': '2.0 dci 29 l2h1 grand confort', 'title': 'renault trafic 29 fourgon mwb dsl - 20 2.0 dci 29 l2h1 grand confort', 'price': 0, 'odometer': 242529, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-14', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 6, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7a667758-de5b-5e96-b2f3-560b6883bf77', 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'renault trafic 29 fourgon mwb dsl - 20', 'sanitized_make': 'renault', 'odometer_in_km': 242529}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '7a667758-de5b-5e96-b2f3-560b6883bf77',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault trafic 29 fourgon mwb dsl - 20',
     'model': 'trafic 29 fourgon mwb dsl - 20',
     'odometer': 242529,
     'odometer_in_km': 242529,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-14',
     'sanitized_make': 'renault',
     'seats_number': 6,
     'seller_name': None,
     'title': 'renault trafic 29 fourgon mwb dsl - 20 2.0 dci 29 l2h1 '
              'grand confort',
     'transmission': 'manual',
     'trim': '2.0 dci 29 l2h1 grand confort',
     'vin': None,
     'year': 2019}
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7a667758-de5b-5e96-b2f3-560b6883bf77 spider: ayvens.be
2026-01-28 20:21:53 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 7a667758-de5b-5e96-b2f3-560b6883bf77 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'renault', 'model': 'trafic 29 fourgon mwb dsl - 20', 'trim': '2.0 dci 29 l2h1 grand confort', 'title': 'renault trafic 29 fourgon mwb dsl - 20 2.0 dci 29 l2h1 grand confort', 'price': 0, 'odometer': 242529, 'odometer_reading_unit': 'km', 'registration_date': '2019-11-14', 'year': 2019, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 6, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '7a667758-de5b-5e96-b2f3-560b6883bf77', 'current_year_diff': 7, 'age_in_months': 74, 'make_model': 'renault trafic 29 fourgon mwb dsl - 20', 'sanitized_make': 'renault', 'odometer_in_km': 242529}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '7a667758-de5b-5e96-b2f3-560b6883bf77',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'renault',
     'make_model': 'renault trafic 29 fourgon mwb dsl - 20',
     'model': 'trafic 29 fourgon mwb dsl - 20',
     'odometer': 242529,
     'odometer_in_km': 242529,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-11-14',
     'sanitized_make': 'renault',
     'seats_number': 6,
     'seller_name': None,
     'title': 'renault trafic 29 fourgon mwb dsl - 20 2.0 dci 29 l2h1 '
              'grand confort',
     'transmission': 'manual',
     'trim': '2.0 dci 29 l2h1 grand confort',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '7a667758-de5b-5e96-b2f3-560b6883bf77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'TRAFIC 29 FOURGON MWB DSL - 20',
 'odometer': 242529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seats_number': 6,
 'seller_name': None,
 'title': 'RENAULT TRAFIC 29 FOURGON MWB DSL - 20 2.0 dCi 29 L2H1 Grand '
          'Confort',
 'transmission': 'manual',
 'trim': '2.0 dCi 29 L2H1 Grand Confort',
 'vin': None,
 'year': 2019}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877098%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Saving data for 1877098: {'auction_closing_time': 1770019200.0, 'created_time': 1769545071.198868, 'last_price_update_time': 1769631713.814134}
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877098') HTTP/1.1" 204 0
2026-01-28 20:21:53 [ayvens.be] INFO: Found listing with ID: 1877099
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877099%27 HTTP/1.1" 200 None
2026-01-28 20:21:53 [ayvens.be] INFO: Scrape type for 1877099: 2
2026-01-28 20:21:53 [ayvens.be] INFO: Extracting data for car ID: 1877099
2026-01-28 20:21:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229c6091-85fb-51a4-8b83-235dc06fdbf1 with identifier: 1877099
2026-01-28 20:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229c6091-85fb-51a4-8b83-235dc06fdbf1 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229c6091-85fb-51a4-8b83-235dc06fdbf1 with scrape type 2
2026-01-28 20:21:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 229c6091-85fb-51a4-8b83-235dc06fdbf1, identifier: 1877099
2026-01-28 20:21:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 229c6091-85fb-51a4-8b83-235dc06fdbf1 with identifier: 1877099
2026-01-28 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 229c6091-85fb-51a4-8b83-235dc06fdbf1 with identifier: 1877099
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 229c6091-85fb-51a4-8b83-235dc06fdbf1 spider: ayvens.be
2026-01-28 20:21:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 229c6091-85fb-51a4-8b83-235dc06fdbf1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '229c6091-85fb-51a4-8b83-235dc06fdbf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS',
 'odometer': 60518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS 1.5 BLUE DCI 95 MAXI CONFORT',
 'transmission': 'manual',
 'trim': '1.5 BLUE DCI 95 MAXI CONFORT',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877099%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Saving data for 1877099: {'auction_closing_time': 1770019200.0, 'created_time': 1769545070.933618, 'last_price_update_time': 1769631714.128098}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877099') HTTP/1.1" 204 0
2026-01-28 20:21:54 [ayvens.be] INFO: Found listing with ID: 1877100
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877100%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Scrape type for 1877100: 2
2026-01-28 20:21:54 [ayvens.be] INFO: Extracting data for car ID: 1877100
2026-01-28 20:21:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09582497-aec9-5c0d-b515-dad20d20fa92 with identifier: 1877100
2026-01-28 20:21:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09582497-aec9-5c0d-b515-dad20d20fa92 with scrape type 2
2026-01-28 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09582497-aec9-5c0d-b515-dad20d20fa92 with scrape type 2
2026-01-28 20:21:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 09582497-aec9-5c0d-b515-dad20d20fa92, identifier: 1877100
2026-01-28 20:21:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 09582497-aec9-5c0d-b515-dad20d20fa92 with identifier: 1877100
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 09582497-aec9-5c0d-b515-dad20d20fa92 with identifier: 1877100
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 09582497-aec9-5c0d-b515-dad20d20fa92 spider: ayvens.be
2026-01-28 20:21:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 09582497-aec9-5c0d-b515-dad20d20fa92 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '09582497-aec9-5c0d-b515-dad20d20fa92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'OPEL',
 'model': 'VIVARO',
 'odometer': 26636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'OPEL VIVARO 1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'transmission': 'manual',
 'trim': '1.5 TURBO 75KW COMFORT L3H1 2.8T',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877100%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Saving data for 1877100: {'auction_closing_time': 1770019200.0, 'created_time': 1769545068.93544, 'last_price_update_time': 1769631714.471812}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877100') HTTP/1.1" 204 0
2026-01-28 20:21:54 [ayvens.be] INFO: Found listing with ID: 1877101
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877101%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Scrape type for 1877101: 2
2026-01-28 20:21:54 [ayvens.be] INFO: Extracting data for car ID: 1877101
2026-01-28 20:21:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732dc000-a420-5ac6-8a91-4186f133f010 with identifier: 1877101
2026-01-28 20:21:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732dc000-a420-5ac6-8a91-4186f133f010 with scrape type 2
2026-01-28 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 732dc000-a420-5ac6-8a91-4186f133f010 with scrape type 2
2026-01-28 20:21:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 732dc000-a420-5ac6-8a91-4186f133f010, identifier: 1877101
2026-01-28 20:21:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 732dc000-a420-5ac6-8a91-4186f133f010 with identifier: 1877101
2026-01-28 20:21:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 732dc000-a420-5ac6-8a91-4186f133f010 with identifier: 1877101
2026-01-28 20:21:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 732dc000-a420-5ac6-8a91-4186f133f010 with identifier: 1877101 to the API
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '732dc000-a420-5ac6-8a91-4186f133f010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 78585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 XL HEAVY CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 XL HEAVY CLUB',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877101%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Saving data for 1877101: {'auction_closing_time': 1770019200.0, 'created_time': 1769545067.446988, 'last_price_update_time': 1769631714.872447}
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877101') HTTP/1.1" 204 0
2026-01-28 20:21:54 [ayvens.be] INFO: Found listing with ID: 1877102
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877102%27 HTTP/1.1" 200 None
2026-01-28 20:21:54 [ayvens.be] INFO: Scrape type for 1877102: 2
2026-01-28 20:21:54 [ayvens.be] INFO: Extracting data for car ID: 1877102
2026-01-28 20:21:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f98f2161-0fa1-5281-aa9a-de6e0f617592 with identifier: 1877102
2026-01-28 20:21:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f98f2161-0fa1-5281-aa9a-de6e0f617592 with scrape type 2
2026-01-28 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f98f2161-0fa1-5281-aa9a-de6e0f617592 with scrape type 2
2026-01-28 20:21:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f98f2161-0fa1-5281-aa9a-de6e0f617592, identifier: 1877102
2026-01-28 20:21:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f98f2161-0fa1-5281-aa9a-de6e0f617592 with identifier: 1877102
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f98f2161-0fa1-5281-aa9a-de6e0f617592 with identifier: 1877102
2026-01-28 20:21:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f98f2161-0fa1-5281-aa9a-de6e0f617592 with identifier: 1877102 to the API
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'f98f2161-0fa1-5281-aa9a-de6e0f617592',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'JUMPY',
 'odometer': 28871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N JUMPY 1.5 BLUEHDI 75KW S-S XL CONTROL',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S XL CONTROL',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877102%27 HTTP/1.1" 200 None
2026-01-28 20:21:55 [ayvens.be] INFO: Saving data for 1877102: {'auction_closing_time': 1770019200.0, 'created_time': 1769545065.535639, 'last_price_update_time': 1769631715.2843}
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877102') HTTP/1.1" 204 0
2026-01-28 20:21:55 [ayvens.be] INFO: Found listing with ID: 1877103
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877103%27 HTTP/1.1" 200 None
2026-01-28 20:21:55 [ayvens.be] INFO: Scrape type for 1877103: 2
2026-01-28 20:21:55 [ayvens.be] INFO: Extracting data for car ID: 1877103
2026-01-28 20:21:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14029eb9-7420-550d-ab2d-a903ebad5b19 with identifier: 1877103
2026-01-28 20:21:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14029eb9-7420-550d-ab2d-a903ebad5b19 with scrape type 2
2026-01-28 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14029eb9-7420-550d-ab2d-a903ebad5b19 with scrape type 2
2026-01-28 20:21:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 14029eb9-7420-550d-ab2d-a903ebad5b19, identifier: 1877103
2026-01-28 20:21:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 14029eb9-7420-550d-ab2d-a903ebad5b19 with identifier: 1877103
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 14029eb9-7420-550d-ab2d-a903ebad5b19 with identifier: 1877103
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156154 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    156154
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 14029eb9-7420-550d-ab2d-a903ebad5b19 spider: ayvens.be
2026-01-28 20:21:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 14029eb9-7420-550d-ab2d-a903ebad5b19 due to rule: high_mileage_for_country.json, error: 156154 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    156154
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '14029eb9-7420-550d-ab2d-a903ebad5b19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 156154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877103%27 HTTP/1.1" 200 None
2026-01-28 20:21:55 [ayvens.be] INFO: Saving data for 1877103: {'auction_closing_time': 1770019200.0, 'created_time': 1769545065.156635, 'last_price_update_time': 1769631715.748444}
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877103') HTTP/1.1" 204 0
2026-01-28 20:21:55 [ayvens.be] INFO: Found listing with ID: 1877104
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877104%27 HTTP/1.1" 200 None
2026-01-28 20:21:55 [ayvens.be] INFO: Scrape type for 1877104: 2
2026-01-28 20:21:55 [ayvens.be] INFO: Extracting data for car ID: 1877104
2026-01-28 20:21:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 with identifier: 1877104
2026-01-28 20:21:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 with scrape type 2
2026-01-28 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 with scrape type 2
2026-01-28 20:21:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06, identifier: 1877104
2026-01-28 20:21:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 with identifier: 1877104
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 with identifier: 1877104
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'volvo', 'model': 'xc90 diesel - 2019', 'trim': '2.0 b5 4wd inscription 7pl. adblue', 'title': 'volvo xc90 diesel - 2019 2.0 b5 4wd inscription 7pl. adblue', 'price': 0, 'odometer': 220452, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-06', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06', 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'volvo xc90 diesel - 2019', 'sanitized_make': 'volvo', 'odometer_in_km': 220452}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'volvo',
     'make_model': 'volvo xc90 diesel - 2019',
     'model': 'xc90 diesel - 2019',
     'odometer': 220452,
     'odometer_in_km': 220452,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-06',
     'sanitized_make': 'volvo',
     'seats_number': 7,
     'seller_name': None,
     'title': 'volvo xc90 diesel - 2019 2.0 b5 4wd inscription 7pl. adblue',
     'transmission': 'automatic',
     'trim': '2.0 b5 4wd inscription 7pl. adblue',
     'vin': None,
     'year': 2020}
2026-01-28 20:21:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 spider: ayvens.be
2026-01-28 20:21:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'volvo', 'model': 'xc90 diesel - 2019', 'trim': '2.0 b5 4wd inscription 7pl. adblue', 'title': 'volvo xc90 diesel - 2019 2.0 b5 4wd inscription 7pl. adblue', 'price': 0, 'odometer': 220452, 'odometer_reading_unit': 'km', 'registration_date': '2020-03-06', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133', 'expiration_date': '2026-02-02t08:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06', 'current_year_diff': 6, 'age_in_months': 70, 'make_model': 'volvo xc90 diesel - 2019', 'sanitized_make': 'volvo', 'odometer_in_km': 220452}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 70,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-02-02t08:00:00z',
     'fuel_type': 'diesel',
     'id': '8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
     'listing': 'auction',
     'location': None,
     'make': 'volvo',
     'make_model': 'volvo xc90 diesel - 2019',
     'model': 'xc90 diesel - 2019',
     'odometer': 220452,
     'odometer_in_km': 220452,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-03-06',
     'sanitized_make': 'volvo',
     'seats_number': 7,
     'seller_name': None,
     'title': 'volvo xc90 diesel - 2019 2.0 b5 4wd inscription 7pl. adblue',
     'transmission': 'automatic',
     'trim': '2.0 b5 4wd inscription 7pl. adblue',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '8fbc6dbc-0ce0-5ec3-90d2-f270be01fc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC90 DIESEL - 2019',
 'odometer': 220452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'VOLVO XC90 DIESEL - 2019 2.0 B5 4WD Inscription 7pl. AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 B5 4WD Inscription 7pl. AdBlue',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877104%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Saving data for 1877104: {'auction_closing_time': 1770019200.0, 'created_time': 1769545063.055278, 'last_price_update_time': 1769631716.101494}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877104') HTTP/1.1" 204 0
2026-01-28 20:21:56 [ayvens.be] INFO: Found listing with ID: 1877105
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877105%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Scrape type for 1877105: 2
2026-01-28 20:21:56 [ayvens.be] INFO: Extracting data for car ID: 1877105
2026-01-28 20:21:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec24b404-d03a-565e-bc20-546376fb512a with identifier: 1877105
2026-01-28 20:21:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec24b404-d03a-565e-bc20-546376fb512a with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec24b404-d03a-565e-bc20-546376fb512a with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ec24b404-d03a-565e-bc20-546376fb512a, identifier: 1877105
2026-01-28 20:21:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ec24b404-d03a-565e-bc20-546376fb512a with identifier: 1877105
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ec24b404-d03a-565e-bc20-546376fb512a with identifier: 1877105
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146685 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146685
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec24b404-d03a-565e-bc20-546376fb512a spider: ayvens.be
2026-01-28 20:21:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ec24b404-d03a-565e-bc20-546376fb512a due to rule: high_mileage_for_country.json, error: 146685 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146685
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': 'ec24b404-d03a-565e-bc20-546376fb512a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 DIESEL - 2019',
 'odometer': 146685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 DIESEL - 2019 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877105%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Saving data for 1877105: {'auction_closing_time': 1770019200.0, 'created_time': 1769545042.949804, 'last_price_update_time': 1769631716.41549}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877105') HTTP/1.1" 204 0
2026-01-28 20:21:56 [ayvens.be] INFO: Found listing with ID: 1877106
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877106%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Scrape type for 1877106: 2
2026-01-28 20:21:56 [ayvens.be] INFO: Extracting data for car ID: 1877106
2026-01-28 20:21:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b76536e-fb66-55e6-987b-a1517dcb870d with identifier: 1877106
2026-01-28 20:21:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b76536e-fb66-55e6-987b-a1517dcb870d with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b76536e-fb66-55e6-987b-a1517dcb870d with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3b76536e-fb66-55e6-987b-a1517dcb870d, identifier: 1877106
2026-01-28 20:21:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3b76536e-fb66-55e6-987b-a1517dcb870d with identifier: 1877106
2026-01-28 20:21:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3b76536e-fb66-55e6-987b-a1517dcb870d with identifier: 1877106
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143538 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143538
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3b76536e-fb66-55e6-987b-a1517dcb870d spider: ayvens.be
2026-01-28 20:21:56 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 3b76536e-fb66-55e6-987b-a1517dcb870d due to rule: high_mileage_for_country.json, error: 143538 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143538
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BANQUISE WHITE GLOSS',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '3b76536e-fb66-55e6-987b-a1517dcb870d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'BERLINGO',
 'odometer': 143538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'CITROAu2039N BERLINGO 1.5 BLUEHDI 100 S-S M LIGHT CLUB',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 100 S-S M LIGHT CLUB',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877106%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Saving data for 1877106: {'auction_closing_time': 1770019200.0, 'created_time': 1769545032.06134, 'last_price_update_time': 1769631716.758989}
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877106') HTTP/1.1" 204 0
2026-01-28 20:21:56 [ayvens.be] INFO: Found listing with ID: 1877107
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877107%27 HTTP/1.1" 200 None
2026-01-28 20:21:56 [ayvens.be] INFO: Scrape type for 1877107: 2
2026-01-28 20:21:56 [ayvens.be] INFO: Extracting data for car ID: 1877107
2026-01-28 20:21:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c95a1a-b312-5866-ad6b-b21fd125ad23 with identifier: 1877107
2026-01-28 20:21:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c95a1a-b312-5866-ad6b-b21fd125ad23 with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c95a1a-b312-5866-ad6b-b21fd125ad23 with scrape type 2
2026-01-28 20:21:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 18c95a1a-b312-5866-ad6b-b21fd125ad23, identifier: 1877107
2026-01-28 20:21:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 18c95a1a-b312-5866-ad6b-b21fd125ad23 with identifier: 1877107
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 18c95a1a-b312-5866-ad6b-b21fd125ad23 with identifier: 1877107
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
2026-01-28 20:21:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 18c95a1a-b312-5866-ad6b-b21fd125ad23 spider: ayvens.be
2026-01-28 20:21:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 18c95a1a-b312-5866-ad6b-b21fd125ad23 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express maxi dsl - 2013' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'IJSWIT',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '18c95a1a-b312-5866-ad6b-b21fd125ad23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KANGOO EXPRESS MAXI DSL - 2013',
 'odometer': 92789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seats_number': 2,
 'seller_name': None,
 'title': 'RENAULT KANGOO EXPRESS MAXI DSL - 2013 1.5 dCi Energy Confort',
 'transmission': 'manual',
 'trim': '1.5 dCi Energy Confort',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877107%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Saving data for 1877107: {'auction_closing_time': 1770019200.0, 'created_time': 1769545036.51984, 'last_price_update_time': 1769631717.091544}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877107') HTTP/1.1" 204 0
2026-01-28 20:21:57 [ayvens.be] INFO: Found listing with ID: 1877108
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877108%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Scrape type for 1877108: 2
2026-01-28 20:21:57 [ayvens.be] INFO: Extracting data for car ID: 1877108
2026-01-28 20:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5203f3c4-8229-50d0-af46-ce0f8031ecaa with identifier: 1877108
2026-01-28 20:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5203f3c4-8229-50d0-af46-ce0f8031ecaa with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5203f3c4-8229-50d0-af46-ce0f8031ecaa with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5203f3c4-8229-50d0-af46-ce0f8031ecaa, identifier: 1877108
2026-01-28 20:21:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5203f3c4-8229-50d0-af46-ce0f8031ecaa with identifier: 1877108
2026-01-28 20:21:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5203f3c4-8229-50d0-af46-ce0f8031ecaa with identifier: 1877108
2026-01-28 20:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 3526 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    3526
2026-01-28 20:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: LOW_MILEAGE_FOR_COUNTRY failed for item: 5203f3c4-8229-50d0-af46-ce0f8031ecaa spider: ayvens.be
2026-01-28 20:21:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5203f3c4-8229-50d0-af46-ce0f8031ecaa due to rule: low_mileage_for_country.json, error: 3526 is less than the minimum of 6000

Failed validating 'minimum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'minimum': 6000, 'type': 'integer'}

On instance['odometer_in_km']:
    3526
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'GROEN',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '0.9L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'diesel',
 'id': '5203f3c4-8229-50d0-af46-ce0f8031ecaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'DM Make',
 'model': 'DM Model',
 'odometer': 3526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-25',
 'seats_number': 1,
 'seller_name': None,
 'title': 'DM Make DM Model XUV865M',
 'transmission': 'manual',
 'trim': 'XUV865M',
 'vin': None,
 'year': 2021}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877108%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Saving data for 1877108: {'auction_closing_time': 1770019200.0, 'created_time': 1769545040.034975, 'last_price_update_time': 1769631717.439757}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877108') HTTP/1.1" 204 0
2026-01-28 20:21:57 [ayvens.be] INFO: Found listing with ID: 1877109
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877109%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Scrape type for 1877109: 2
2026-01-28 20:21:57 [ayvens.be] INFO: Extracting data for car ID: 1877109
2026-01-28 20:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with identifier: 1877109
2026-01-28 20:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa, identifier: 1877109
2026-01-28 20:21:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with identifier: 1877109
2026-01-28 20:21:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with identifier: 1877109
2026-01-28 20:21:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b4021d7-a6e4-5763-b24a-44aa4c72d8fa with identifier: 1877109 to the API
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLACK',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '1b4021d7-a6e4-5763-b24a-44aa4c72d8fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 HATCH - 2015',
 'odometer': 110853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 HATCH - 2015 116i',
 'transmission': 'manual',
 'trim': '116i',
 'vin': None,
 'year': 2018}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877109%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Saving data for 1877109: {'auction_closing_time': 1770019200.0, 'created_time': 1769545043.346699, 'last_price_update_time': 1769631717.851784}
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877109') HTTP/1.1" 204 0
2026-01-28 20:21:57 [ayvens.be] INFO: Found listing with ID: 1877110
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877110%27 HTTP/1.1" 200 None
2026-01-28 20:21:57 [ayvens.be] INFO: Scrape type for 1877110: 2
2026-01-28 20:21:57 [ayvens.be] INFO: Extracting data for car ID: 1877110
2026-01-28 20:21:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26607aa7-03b3-53c6-88c9-7da9a48195f9 with identifier: 1877110
2026-01-28 20:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26607aa7-03b3-53c6-88c9-7da9a48195f9 with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26607aa7-03b3-53c6-88c9-7da9a48195f9 with scrape type 2
2026-01-28 20:21:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26607aa7-03b3-53c6-88c9-7da9a48195f9, identifier: 1877110
2026-01-28 20:21:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26607aa7-03b3-53c6-88c9-7da9a48195f9 with identifier: 1877110
2026-01-28 20:21:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26607aa7-03b3-53c6-88c9-7da9a48195f9 with identifier: 1877110
2026-01-28 20:21:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26607aa7-03b3-53c6-88c9-7da9a48195f9 with identifier: 1877110 to the API
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.4L',
 'expiration_date': '2026-02-02T08:00:00Z',
 'fuel_type': 'petrol',
 'id': '26607aa7-03b3-53c6-88c9-7da9a48195f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39133',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT GTE - 2020',
 'odometer': 73426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN PASSAT GTE - 2020 1.4 TSI PHEV GTE DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV GTE DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877110%27 HTTP/1.1" 200 None
2026-01-28 20:21:58 [ayvens.be] INFO: Saving data for 1877110: {'auction_closing_time': 1770019200.0, 'created_time': 1769545058.102091, 'last_price_update_time': 1769631718.236076}
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877110') HTTP/1.1" 204 0
2026-01-28 20:21:58 [ayvens.be] INFO: Found listing with ID: 1873004
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873004%27 HTTP/1.1" 200 None
2026-01-28 20:21:58 [ayvens.be] INFO: Scrape type for 1873004: 2
2026-01-28 20:21:58 [ayvens.be] INFO: Extracting data for car ID: 1873004
2026-01-28 20:21:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with identifier: 1873004
2026-01-28 20:21:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with scrape type 2
2026-01-28 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with scrape type 2
2026-01-28 20:21:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f453f44e-d4a9-576b-bb0e-bb6249a5ea4c, identifier: 1873004
2026-01-28 20:21:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with identifier: 1873004
2026-01-28 20:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with identifier: 1873004
2026-01-28 20:21:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f453f44e-d4a9-576b-bb0e-bb6249a5ea4c with identifier: 1873004 to the API
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'f453f44e-d4a9-576b-bb0e-bb6249a5ea4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VARIANT',
 'odometer': 121603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VARIANT 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': '1.6 TDI IQ.DRIVE',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873004%27 HTTP/1.1" 200 None
2026-01-28 20:21:58 [ayvens.be] INFO: Saving data for 1873004: {'auction_closing_time': 1769761800.0, 'created_time': 1769457635.568187, 'last_price_update_time': 1769631718.637921}
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873004') HTTP/1.1" 204 0
2026-01-28 20:21:58 [ayvens.be] INFO: Found listing with ID: 1873005
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873005%27 HTTP/1.1" 200 None
2026-01-28 20:21:58 [ayvens.be] INFO: Scrape type for 1873005: 2
2026-01-28 20:21:58 [ayvens.be] INFO: Extracting data for car ID: 1873005
2026-01-28 20:21:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe2c0252-f26a-5487-aeee-85edfe96df9e with identifier: 1873005
2026-01-28 20:21:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe2c0252-f26a-5487-aeee-85edfe96df9e with scrape type 2
2026-01-28 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe2c0252-f26a-5487-aeee-85edfe96df9e with scrape type 2
2026-01-28 20:21:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fe2c0252-f26a-5487-aeee-85edfe96df9e, identifier: 1873005
2026-01-28 20:21:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fe2c0252-f26a-5487-aeee-85edfe96df9e with identifier: 1873005
2026-01-28 20:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fe2c0252-f26a-5487-aeee-85edfe96df9e with identifier: 1873005
2026-01-28 20:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131042 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    131042
2026-01-28 20:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fe2c0252-f26a-5487-aeee-85edfe96df9e spider: ayvens.be
2026-01-28 20:21:58 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: fe2c0252-f26a-5487-aeee-85edfe96df9e due to rule: high_mileage_for_country.json, error: 131042 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    131042
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'fe2c0252-f26a-5487-aeee-85edfe96df9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE COUPE',
 'odometer': 131042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE COUPE 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873005%27 HTTP/1.1" 200 None
2026-01-28 20:21:58 [ayvens.be] INFO: Saving data for 1873005: {'auction_closing_time': 1769761800.0, 'created_time': 1769458376.935423, 'last_price_update_time': 1769631718.999299}
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873005') HTTP/1.1" 204 0
2026-01-28 20:21:59 [ayvens.be] INFO: Found listing with ID: 1873006
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873006%27 HTTP/1.1" 200 None
2026-01-28 20:21:59 [ayvens.be] INFO: Scrape type for 1873006: 2
2026-01-28 20:21:59 [ayvens.be] INFO: Extracting data for car ID: 1873006
2026-01-28 20:21:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26129e9-8e39-52b1-9c1a-218ac1dde984 with identifier: 1873006
2026-01-28 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26129e9-8e39-52b1-9c1a-218ac1dde984 with scrape type 2
2026-01-28 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26129e9-8e39-52b1-9c1a-218ac1dde984 with scrape type 2
2026-01-28 20:21:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d26129e9-8e39-52b1-9c1a-218ac1dde984, identifier: 1873006
2026-01-28 20:21:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d26129e9-8e39-52b1-9c1a-218ac1dde984 with identifier: 1873006
2026-01-28 20:21:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d26129e9-8e39-52b1-9c1a-218ac1dde984 with identifier: 1873006
2026-01-28 20:21:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d26129e9-8e39-52b1-9c1a-218ac1dde984 with identifier: 1873006 to the API
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'd26129e9-8e39-52b1-9c1a-218ac1dde984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'CITROAu2039N',
 'model': 'GRAND C4 SPACETOURER',
 'odometer': 98772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CITROAu2039N GRAND C4 SPACETOURER 1.5 BLUEHDI 130 S-S SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S-S SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873006%27 HTTP/1.1" 200 None
2026-01-28 20:21:59 [ayvens.be] INFO: Saving data for 1873006: {'auction_closing_time': 1769761800.0, 'created_time': 1769457653.367156, 'last_price_update_time': 1769631719.386373}
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873006') HTTP/1.1" 204 0
2026-01-28 20:21:59 [ayvens.be] INFO: Found listing with ID: 1873007
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873007%27 HTTP/1.1" 200 None
2026-01-28 20:21:59 [ayvens.be] INFO: Scrape type for 1873007: 2
2026-01-28 20:21:59 [ayvens.be] INFO: Extracting data for car ID: 1873007
2026-01-28 20:21:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d593cefb-7fc9-5610-8ff5-465e4c26504b with identifier: 1873007
2026-01-28 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d593cefb-7fc9-5610-8ff5-465e4c26504b with scrape type 2
2026-01-28 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d593cefb-7fc9-5610-8ff5-465e4c26504b with scrape type 2
2026-01-28 20:21:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d593cefb-7fc9-5610-8ff5-465e4c26504b, identifier: 1873007
2026-01-28 20:21:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d593cefb-7fc9-5610-8ff5-465e4c26504b with identifier: 1873007
2026-01-28 20:21:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d593cefb-7fc9-5610-8ff5-465e4c26504b with identifier: 1873007
2026-01-28 20:21:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d593cefb-7fc9-5610-8ff5-465e4c26504b with identifier: 1873007 to the API
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:21:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'd593cefb-7fc9-5610-8ff5-465e4c26504b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q4 E-TRON',
 'odometer': 22905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q4 E-TRON BEV 82KWH 40 ATTRACTION AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 82KWH 40 ATTRACTION AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873007%27 HTTP/1.1" 200 None
2026-01-28 20:21:59 [ayvens.be] INFO: Saving data for 1873007: {'auction_closing_time': 1769761800.0, 'created_time': 1769457660.045509, 'last_price_update_time': 1769631719.894817}
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873007') HTTP/1.1" 204 0
2026-01-28 20:21:59 [ayvens.be] INFO: Found listing with ID: 1873008
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873008%27 HTTP/1.1" 200 None
2026-01-28 20:21:59 [ayvens.be] INFO: Scrape type for 1873008: 2
2026-01-28 20:21:59 [ayvens.be] INFO: Extracting data for car ID: 1873008
2026-01-28 20:21:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 663bf05e-eed5-5330-8ce0-0e19d72de152 with identifier: 1873008
2026-01-28 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 663bf05e-eed5-5330-8ce0-0e19d72de152 with scrape type 2
2026-01-28 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 663bf05e-eed5-5330-8ce0-0e19d72de152 with scrape type 2
2026-01-28 20:22:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 663bf05e-eed5-5330-8ce0-0e19d72de152, identifier: 1873008
2026-01-28 20:22:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 663bf05e-eed5-5330-8ce0-0e19d72de152 with identifier: 1873008
2026-01-28 20:22:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 663bf05e-eed5-5330-8ce0-0e19d72de152 with identifier: 1873008
2026-01-28 20:22:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 663bf05e-eed5-5330-8ce0-0e19d72de152 with identifier: 1873008 to the API
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '663bf05e-eed5-5330-8ce0-0e19d72de152',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'POLO - 2018',
 'odometer': 64877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN POLO - 2018 1.0 TSi Comfortline OPF',
 'transmission': 'manual',
 'trim': '1.0 TSi Comfortline OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873008%27 HTTP/1.1" 200 None
2026-01-28 20:22:00 [ayvens.be] INFO: Saving data for 1873008: {'auction_closing_time': 1769761800.0, 'created_time': 1769458369.852711, 'last_price_update_time': 1769631720.311481}
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873008') HTTP/1.1" 204 0
2026-01-28 20:22:00 [ayvens.be] INFO: Found listing with ID: 1873009
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873009%27 HTTP/1.1" 200 None
2026-01-28 20:22:00 [ayvens.be] INFO: Scrape type for 1873009: 2
2026-01-28 20:22:00 [ayvens.be] INFO: Extracting data for car ID: 1873009
2026-01-28 20:22:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7b2291-a9d7-5745-830b-41528a110766 with identifier: 1873009
2026-01-28 20:22:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7b2291-a9d7-5745-830b-41528a110766 with scrape type 2
2026-01-28 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7b2291-a9d7-5745-830b-41528a110766 with scrape type 2
2026-01-28 20:22:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c7b2291-a9d7-5745-830b-41528a110766, identifier: 1873009
2026-01-28 20:22:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c7b2291-a9d7-5745-830b-41528a110766 with identifier: 1873009
2026-01-28 20:22:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c7b2291-a9d7-5745-830b-41528a110766 with identifier: 1873009
2026-01-28 20:22:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7c7b2291-a9d7-5745-830b-41528a110766 with identifier: 1873009 to the API
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7c7b2291-a9d7-5745-830b-41528a110766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 DIESEL - 2019',
 'odometer': 106065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 DIESEL - 2019 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873009%27 HTTP/1.1" 200 None
2026-01-28 20:22:00 [ayvens.be] INFO: Saving data for 1873009: {'auction_closing_time': 1769761800.0, 'created_time': 1769458368.875604, 'last_price_update_time': 1769631720.695985}
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873009') HTTP/1.1" 204 0
2026-01-28 20:22:00 [ayvens.be] INFO: Found listing with ID: 1873010
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873010%27 HTTP/1.1" 200 None
2026-01-28 20:22:00 [ayvens.be] INFO: Scrape type for 1873010: 2
2026-01-28 20:22:00 [ayvens.be] INFO: Extracting data for car ID: 1873010
2026-01-28 20:22:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with identifier: 1873010
2026-01-28 20:22:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with scrape type 2
2026-01-28 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with scrape type 2
2026-01-28 20:22:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7, identifier: 1873010
2026-01-28 20:22:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with identifier: 1873010
2026-01-28 20:22:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with identifier: 1873010
2026-01-28 20:22:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2a0351a1-7885-5bd0-82b4-1dd8e90e21b7 with identifier: 1873010 to the API
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': '2a0351a1-7885-5bd0-82b4-1dd8e90e21b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 77954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 50 KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': '50 KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873010%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Saving data for 1873010: {'auction_closing_time': 1769761800.0, 'created_time': 1769457679.618939, 'last_price_update_time': 1769631721.093504}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873010') HTTP/1.1" 204 0
2026-01-28 20:22:01 [ayvens.be] INFO: Found listing with ID: 1873011
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873011%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Scrape type for 1873011: 2
2026-01-28 20:22:01 [ayvens.be] INFO: Extracting data for car ID: 1873011
2026-01-28 20:22:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 with identifier: 1873011
2026-01-28 20:22:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 with scrape type 2
2026-01-28 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 with scrape type 2
2026-01-28 20:22:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4, identifier: 1873011
2026-01-28 20:22:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 with identifier: 1873011
2026-01-28 20:22:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:22:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 with identifier: 1873011
2026-01-28 20:22:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139332 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    139332
2026-01-28 20:22:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 spider: ayvens.be
2026-01-28 20:22:01 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d353a9dd-058a-5dbb-b07b-f06ddda5f0a4 due to rule: high_mileage_for_country.json, error: 139332 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    139332
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'color': 'EMERALD GREEN',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd353a9dd-058a-5dbb-b07b-f06ddda5f0a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'SUPERB - 2019',
 'odometer': 139332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA SUPERB - 2019 1.4 TSI PHEV Ambition DSG',
 'transmission': 'automatic',
 'trim': '1.4 TSI PHEV Ambition DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873011%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Saving data for 1873011: {'auction_closing_time': 1769761800.0, 'created_time': 1769458367.023994, 'last_price_update_time': 1769631721.460123}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873011') HTTP/1.1" 204 0
2026-01-28 20:22:01 [ayvens.be] INFO: Found listing with ID: 1873012
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873012%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Scrape type for 1873012: 2
2026-01-28 20:22:01 [ayvens.be] INFO: Extracting data for car ID: 1873012
2026-01-28 20:22:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e489ea-52bb-56ba-89e1-42f69e137114 with identifier: 1873012
2026-01-28 20:22:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e489ea-52bb-56ba-89e1-42f69e137114 with scrape type 2
2026-01-28 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e489ea-52bb-56ba-89e1-42f69e137114 with scrape type 2
2026-01-28 20:22:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b1e489ea-52bb-56ba-89e1-42f69e137114, identifier: 1873012
2026-01-28 20:22:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b1e489ea-52bb-56ba-89e1-42f69e137114 with identifier: 1873012
2026-01-28 20:22:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:22:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b1e489ea-52bb-56ba-89e1-42f69e137114 with identifier: 1873012
2026-01-28 20:22:01 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b1e489ea-52bb-56ba-89e1-42f69e137114 with identifier: 1873012 to the API
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'DAYTONAGRIJS',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b1e489ea-52bb-56ba-89e1-42f69e137114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 DIESEL - 2019',
 'odometer': 112838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 DIESEL - 2019 35 TDi Business Edition S line S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S line S tronic',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873012%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Saving data for 1873012: {'auction_closing_time': 1769761800.0, 'created_time': 1769457697.01785, 'last_price_update_time': 1769631721.861184}
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873012') HTTP/1.1" 204 0
2026-01-28 20:22:01 [ayvens.be] INFO: Found listing with ID: 1873013
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873013%27 HTTP/1.1" 200 None
2026-01-28 20:22:01 [ayvens.be] INFO: Scrape type for 1873013: 2
2026-01-28 20:22:01 [ayvens.be] INFO: Extracting data for car ID: 1873013
2026-01-28 20:22:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e55363c-52c0-5725-b8bc-92765b9734fd with identifier: 1873013
2026-01-28 20:22:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e55363c-52c0-5725-b8bc-92765b9734fd with scrape type 2
2026-01-28 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e55363c-52c0-5725-b8bc-92765b9734fd with scrape type 2
2026-01-28 20:22:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e55363c-52c0-5725-b8bc-92765b9734fd, identifier: 1873013
2026-01-28 20:22:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e55363c-52c0-5725-b8bc-92765b9734fd with identifier: 1873013
2026-01-28 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e55363c-52c0-5725-b8bc-92765b9734fd with identifier: 1873013
2026-01-28 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137635 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    137635
2026-01-28 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8e55363c-52c0-5725-b8bc-92765b9734fd spider: ayvens.be
2026-01-28 20:22:02 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8e55363c-52c0-5725-b8bc-92765b9734fd due to rule: high_mileage_for_country.json, error: 137635 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    137635
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8e55363c-52c0-5725-b8bc-92765b9734fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 137635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.6 HYBRID 225 E-AUTO GT',
 'transmission': 'automatic',
 'trim': '1.6 HYBRID 225 E-AUTO GT',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873013%27 HTTP/1.1" 200 None
2026-01-28 20:22:02 [ayvens.be] INFO: Saving data for 1873013: {'auction_closing_time': 1769761800.0, 'created_time': 1769458369.096174, 'last_price_update_time': 1769631722.210065}
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873013') HTTP/1.1" 204 0
2026-01-28 20:22:02 [ayvens.be] INFO: Found listing with ID: 1873014
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873014%27 HTTP/1.1" 200 None
2026-01-28 20:22:02 [ayvens.be] INFO: Scrape type for 1873014: 2
2026-01-28 20:22:02 [ayvens.be] INFO: Extracting data for car ID: 1873014
2026-01-28 20:22:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31dca3a-c4d0-51af-a9b9-de2af80b1865 with identifier: 1873014
2026-01-28 20:22:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31dca3a-c4d0-51af-a9b9-de2af80b1865 with scrape type 2
2026-01-28 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31dca3a-c4d0-51af-a9b9-de2af80b1865 with scrape type 2
2026-01-28 20:22:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d31dca3a-c4d0-51af-a9b9-de2af80b1865, identifier: 1873014
2026-01-28 20:22:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d31dca3a-c4d0-51af-a9b9-de2af80b1865 with identifier: 1873014
2026-01-28 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d31dca3a-c4d0-51af-a9b9-de2af80b1865 with identifier: 1873014
2026-01-28 20:22:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d31dca3a-c4d0-51af-a9b9-de2af80b1865 with identifier: 1873014 to the API
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd31dca3a-c4d0-51af-a9b9-de2af80b1865',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 60167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'transmission': 'automatic',
 'trim': '1.5 T4 RECHARGE GEARTR. INSCRIPTION EXPR',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873014%27 HTTP/1.1" 200 None
2026-01-28 20:22:02 [ayvens.be] INFO: Saving data for 1873014: {'auction_closing_time': 1769761800.0, 'created_time': 1769458365.678804, 'last_price_update_time': 1769631722.616317}
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873014') HTTP/1.1" 204 0
2026-01-28 20:22:02 [ayvens.be] INFO: Found listing with ID: 1873015
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873015%27 HTTP/1.1" 200 None
2026-01-28 20:22:02 [ayvens.be] INFO: Scrape type for 1873015: 2
2026-01-28 20:22:02 [ayvens.be] INFO: Extracting data for car ID: 1873015
2026-01-28 20:22:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddf05289-0718-5f63-877a-78ebce40eb8e with identifier: 1873015
2026-01-28 20:22:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddf05289-0718-5f63-877a-78ebce40eb8e with scrape type 2
2026-01-28 20:22:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddf05289-0718-5f63-877a-78ebce40eb8e with scrape type 2
2026-01-28 20:22:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ddf05289-0718-5f63-877a-78ebce40eb8e, identifier: 1873015
2026-01-28 20:22:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ddf05289-0718-5f63-877a-78ebce40eb8e with identifier: 1873015
2026-01-28 20:22:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ddf05289-0718-5f63-877a-78ebce40eb8e with identifier: 1873015
2026-01-28 20:22:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ddf05289-0718-5f63-877a-78ebce40eb8e with identifier: 1873015 to the API
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ddf05289-0718-5f63-877a-78ebce40eb8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 62435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873015%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Saving data for 1873015: {'auction_closing_time': 1769761800.0, 'created_time': 1769458364.527014, 'last_price_update_time': 1769631723.065935}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873015') HTTP/1.1" 204 0
2026-01-28 20:22:03 [ayvens.be] INFO: Found listing with ID: 1873016
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873016%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Scrape type for 1873016: 2
2026-01-28 20:22:03 [ayvens.be] INFO: Extracting data for car ID: 1873016
2026-01-28 20:22:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea75275-731f-52da-91b7-001eceb9fa33 with identifier: 1873016
2026-01-28 20:22:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea75275-731f-52da-91b7-001eceb9fa33 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea75275-731f-52da-91b7-001eceb9fa33 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dea75275-731f-52da-91b7-001eceb9fa33, identifier: 1873016
2026-01-28 20:22:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dea75275-731f-52da-91b7-001eceb9fa33 with identifier: 1873016
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dea75275-731f-52da-91b7-001eceb9fa33 with identifier: 1873016
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157124 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    157124
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dea75275-731f-52da-91b7-001eceb9fa33 spider: ayvens.be
2026-01-28 20:22:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: dea75275-731f-52da-91b7-001eceb9fa33 due to rule: high_mileage_for_country.json, error: 157124 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    157124
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dea75275-731f-52da-91b7-001eceb9fa33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60 DIESEL - 2017',
 'odometer': 157124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 DIESEL - 2017 2.0 D4 Momentum Pro Geartronic AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 D4 Momentum Pro Geartronic AdBlue',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873016%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Saving data for 1873016: {'auction_closing_time': 1769761800.0, 'created_time': 1769457740.949299, 'last_price_update_time': 1769631723.407884}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873016') HTTP/1.1" 204 0
2026-01-28 20:22:03 [ayvens.be] INFO: Found listing with ID: 1873017
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873017%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Scrape type for 1873017: 2
2026-01-28 20:22:03 [ayvens.be] INFO: Extracting data for car ID: 1873017
2026-01-28 20:22:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1422cf6-e4a6-51b4-be21-e1783506a1a7 with identifier: 1873017
2026-01-28 20:22:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1422cf6-e4a6-51b4-be21-e1783506a1a7 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1422cf6-e4a6-51b4-be21-e1783506a1a7 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c1422cf6-e4a6-51b4-be21-e1783506a1a7, identifier: 1873017
2026-01-28 20:22:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c1422cf6-e4a6-51b4-be21-e1783506a1a7 with identifier: 1873017
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c1422cf6-e4a6-51b4-be21-e1783506a1a7 with identifier: 1873017
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 129306 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129306
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c1422cf6-e4a6-51b4-be21-e1783506a1a7 spider: ayvens.be
2026-01-28 20:22:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c1422cf6-e4a6-51b4-be21-e1783506a1a7 due to rule: high_mileage_for_country.json, error: 129306 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    129306
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c1422cf6-e4a6-51b4-be21-e1783506a1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLE',
 'odometer': 129306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLE 2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLE 350 DE 4MATIC 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873017%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Saving data for 1873017: {'auction_closing_time': 1769761800.0, 'created_time': 1769457740.668158, 'last_price_update_time': 1769631723.733168}
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873017') HTTP/1.1" 204 0
2026-01-28 20:22:03 [ayvens.be] INFO: Found listing with ID: 1873018
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873018%27 HTTP/1.1" 200 None
2026-01-28 20:22:03 [ayvens.be] INFO: Scrape type for 1873018: 2
2026-01-28 20:22:03 [ayvens.be] INFO: Extracting data for car ID: 1873018
2026-01-28 20:22:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd117367-c91c-57a2-9e74-c1655d8d6d78 with identifier: 1873018
2026-01-28 20:22:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd117367-c91c-57a2-9e74-c1655d8d6d78 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd117367-c91c-57a2-9e74-c1655d8d6d78 with scrape type 2
2026-01-28 20:22:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: bd117367-c91c-57a2-9e74-c1655d8d6d78, identifier: 1873018
2026-01-28 20:22:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: bd117367-c91c-57a2-9e74-c1655d8d6d78 with identifier: 1873018
2026-01-28 20:22:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: bd117367-c91c-57a2-9e74-c1655d8d6d78 with identifier: 1873018
2026-01-28 20:22:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: bd117367-c91c-57a2-9e74-c1655d8d6d78 with identifier: 1873018 to the API
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'bd117367-c91c-57a2-9e74-c1655d8d6d78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 87324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873018%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Saving data for 1873018: {'auction_closing_time': 1769761800.0, 'created_time': 1769457737.841843, 'last_price_update_time': 1769631724.214194}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873018') HTTP/1.1" 204 0
2026-01-28 20:22:04 [ayvens.be] INFO: Found listing with ID: 1873019
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873019%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Scrape type for 1873019: 2
2026-01-28 20:22:04 [ayvens.be] INFO: Extracting data for car ID: 1873019
2026-01-28 20:22:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02fece51-5bbb-501b-908d-141bfdafda92 with identifier: 1873019
2026-01-28 20:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02fece51-5bbb-501b-908d-141bfdafda92 with scrape type 2
2026-01-28 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02fece51-5bbb-501b-908d-141bfdafda92 with scrape type 2
2026-01-28 20:22:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 02fece51-5bbb-501b-908d-141bfdafda92, identifier: 1873019
2026-01-28 20:22:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 02fece51-5bbb-501b-908d-141bfdafda92 with identifier: 1873019
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 02fece51-5bbb-501b-908d-141bfdafda92 with identifier: 1873019
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 02fece51-5bbb-501b-908d-141bfdafda92 spider: ayvens.be
2026-01-28 20:22:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 02fece51-5bbb-501b-908d-141bfdafda92 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '02fece51-5bbb-501b-908d-141bfdafda92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': 'RIFTER',
 'odometer': 165690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT RIFTER 1.5 BLUEHDI 75KW S-S ACTIVE',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 75KW S-S ACTIVE',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873019%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Saving data for 1873019: {'auction_closing_time': 1769761800.0, 'created_time': 1769457736.5813, 'last_price_update_time': 1769631724.558792}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873019') HTTP/1.1" 204 0
2026-01-28 20:22:04 [ayvens.be] INFO: Found listing with ID: 1873020
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873020%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Scrape type for 1873020: 2
2026-01-28 20:22:04 [ayvens.be] INFO: Extracting data for car ID: 1873020
2026-01-28 20:22:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c with identifier: 1873020
2026-01-28 20:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c with scrape type 2
2026-01-28 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c with scrape type 2
2026-01-28 20:22:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c, identifier: 1873020
2026-01-28 20:22:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c with identifier: 1873020
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c with identifier: 1873020
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137168 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    137168
2026-01-28 20:22:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c spider: ayvens.be
2026-01-28 20:22:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 7c6df12e-26d8-52bf-9e0e-9eed7a76c02c due to rule: high_mileage_for_country.json, error: 137168 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    137168
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '7c6df12e-26d8-52bf-9e0e-9eed7a76c02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 7 CROSSBACK',
 'odometer': 137168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 7 CROSSBACK 1.5 BLUEHDI 130 PERFORMANCE LINE AUTO',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 PERFORMANCE LINE AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873020%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Saving data for 1873020: {'auction_closing_time': 1769761800.0, 'created_time': 1769457748.606898, 'last_price_update_time': 1769631724.881813}
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873020') HTTP/1.1" 204 0
2026-01-28 20:22:04 [ayvens.be] INFO: Found listing with ID: 1873021
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873021%27 HTTP/1.1" 200 None
2026-01-28 20:22:04 [ayvens.be] INFO: Scrape type for 1873021: 2
2026-01-28 20:22:04 [ayvens.be] INFO: Extracting data for car ID: 1873021
2026-01-28 20:22:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c400e074-5bce-53c1-b9b7-b6dd1a786179 with identifier: 1873021
2026-01-28 20:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c400e074-5bce-53c1-b9b7-b6dd1a786179 with scrape type 2
2026-01-28 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c400e074-5bce-53c1-b9b7-b6dd1a786179 with scrape type 2
2026-01-28 20:22:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c400e074-5bce-53c1-b9b7-b6dd1a786179, identifier: 1873021
2026-01-28 20:22:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c400e074-5bce-53c1-b9b7-b6dd1a786179 with identifier: 1873021
2026-01-28 20:22:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:22:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c400e074-5bce-53c1-b9b7-b6dd1a786179 with identifier: 1873021
2026-01-28 20:22:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c400e074-5bce-53c1-b9b7-b6dd1a786179 with identifier: 1873021 to the API
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'A',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c400e074-5bce-53c1-b9b7-b6dd1a786179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '2 SERIES GRAN COUPE',
 'odometer': 119347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 SERIES GRAN COUPE 1.5 218I GRAN COUPE',
 'transmission': 'manual',
 'trim': '1.5 218I GRAN COUPE',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873021%27 HTTP/1.1" 200 None
2026-01-28 20:22:05 [ayvens.be] INFO: Saving data for 1873021: {'auction_closing_time': 1769761800.0, 'created_time': 1769457754.073992, 'last_price_update_time': 1769631725.319214}
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873021') HTTP/1.1" 204 0
2026-01-28 20:22:05 [ayvens.be] INFO: Found listing with ID: 1873022
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873022%27 HTTP/1.1" 200 None
2026-01-28 20:22:05 [ayvens.be] INFO: Scrape type for 1873022: 2
2026-01-28 20:22:05 [ayvens.be] INFO: Extracting data for car ID: 1873022
2026-01-28 20:22:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d549f887-9ab6-5891-8d9c-217842cde8d5 with identifier: 1873022
2026-01-28 20:22:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d549f887-9ab6-5891-8d9c-217842cde8d5 with scrape type 2
2026-01-28 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d549f887-9ab6-5891-8d9c-217842cde8d5 with scrape type 2
2026-01-28 20:22:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d549f887-9ab6-5891-8d9c-217842cde8d5, identifier: 1873022
2026-01-28 20:22:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d549f887-9ab6-5891-8d9c-217842cde8d5 with identifier: 1873022
2026-01-28 20:22:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d549f887-9ab6-5891-8d9c-217842cde8d5 with identifier: 1873022
2026-01-28 20:22:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d549f887-9ab6-5891-8d9c-217842cde8d5 with identifier: 1873022 to the API
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd549f887-9ab6-5891-8d9c-217842cde8d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 75277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 180 ESSENTIAL LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 180 ESSENTIAL LINE DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873022%27 HTTP/1.1" 200 None
2026-01-28 20:22:05 [ayvens.be] INFO: Saving data for 1873022: {'auction_closing_time': 1769761800.0, 'created_time': 1769458364.101469, 'last_price_update_time': 1769631725.733411}
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873022') HTTP/1.1" 204 0
2026-01-28 20:22:05 [ayvens.be] INFO: Found listing with ID: 1873023
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873023%27 HTTP/1.1" 200 None
2026-01-28 20:22:05 [ayvens.be] INFO: Scrape type for 1873023: 2
2026-01-28 20:22:05 [ayvens.be] INFO: Extracting data for car ID: 1873023
2026-01-28 20:22:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9891ce09-b82e-5108-93ce-61e1512b0072 with identifier: 1873023
2026-01-28 20:22:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9891ce09-b82e-5108-93ce-61e1512b0072 with scrape type 2
2026-01-28 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9891ce09-b82e-5108-93ce-61e1512b0072 with scrape type 2
2026-01-28 20:22:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9891ce09-b82e-5108-93ce-61e1512b0072, identifier: 1873023
2026-01-28 20:22:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9891ce09-b82e-5108-93ce-61e1512b0072 with identifier: 1873023
2026-01-28 20:22:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9891ce09-b82e-5108-93ce-61e1512b0072 with identifier: 1873023
2026-01-28 20:22:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9891ce09-b82e-5108-93ce-61e1512b0072 with identifier: 1873023 to the API
2026-01-28 20:22:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '9891ce09-b82e-5108-93ce-61e1512b0072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'KIA',
 'model': 'NIRO',
 'odometer': 39910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA NIRO 1.6 GDI PHEV PACE',
 'transmission': 'automatic',
 'trim': '1.6 GDI PHEV PACE',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873023%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Saving data for 1873023: {'auction_closing_time': 1769761800.0, 'created_time': 1769457782.63243, 'last_price_update_time': 1769631726.144084}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873023') HTTP/1.1" 204 0
2026-01-28 20:22:06 [ayvens.be] INFO: Found listing with ID: 1873024
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873024%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Scrape type for 1873024: 2
2026-01-28 20:22:06 [ayvens.be] INFO: Extracting data for car ID: 1873024
2026-01-28 20:22:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc403a3-2c52-51e0-ba8f-818427e1368e with identifier: 1873024
2026-01-28 20:22:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc403a3-2c52-51e0-ba8f-818427e1368e with scrape type 2
2026-01-28 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fc403a3-2c52-51e0-ba8f-818427e1368e with scrape type 2
2026-01-28 20:22:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8fc403a3-2c52-51e0-ba8f-818427e1368e, identifier: 1873024
2026-01-28 20:22:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8fc403a3-2c52-51e0-ba8f-818427e1368e with identifier: 1873024
2026-01-28 20:22:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8fc403a3-2c52-51e0-ba8f-818427e1368e with identifier: 1873024
2026-01-28 20:22:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 8fc403a3-2c52-51e0-ba8f-818427e1368e with identifier: 1873024 to the API
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '8fc403a3-2c52-51e0-ba8f-818427e1368e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 120873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T2 MOMENTUM CORE',
 'transmission': 'manual',
 'trim': '1.5 T2 MOMENTUM CORE',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873024%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Saving data for 1873024: {'auction_closing_time': 1769761800.0, 'created_time': 1769457778.509105, 'last_price_update_time': 1769631726.53813}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873024') HTTP/1.1" 204 0
2026-01-28 20:22:06 [ayvens.be] INFO: Found listing with ID: 1873025
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873025%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Scrape type for 1873025: 2
2026-01-28 20:22:06 [ayvens.be] INFO: Extracting data for car ID: 1873025
2026-01-28 20:22:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c68ca5e-6477-53c3-af56-008075c9f63b with identifier: 1873025
2026-01-28 20:22:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c68ca5e-6477-53c3-af56-008075c9f63b with scrape type 2
2026-01-28 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c68ca5e-6477-53c3-af56-008075c9f63b with scrape type 2
2026-01-28 20:22:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c68ca5e-6477-53c3-af56-008075c9f63b, identifier: 1873025
2026-01-28 20:22:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c68ca5e-6477-53c3-af56-008075c9f63b with identifier: 1873025
2026-01-28 20:22:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c68ca5e-6477-53c3-af56-008075c9f63b with identifier: 1873025
2026-01-28 20:22:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5c68ca5e-6477-53c3-af56-008075c9f63b with identifier: 1873025 to the API
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': '5c68ca5e-6477-53c3-af56-008075c9f63b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 33211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 50KWH STANDARD RWD PLUS AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 50KWH STANDARD RWD PLUS AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873025%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Saving data for 1873025: {'auction_closing_time': 1769761800.0, 'created_time': 1769458361.200125, 'last_price_update_time': 1769631726.947948}
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873025') HTTP/1.1" 204 0
2026-01-28 20:22:06 [ayvens.be] INFO: Found listing with ID: 1873026
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873026%27 HTTP/1.1" 200 None
2026-01-28 20:22:06 [ayvens.be] INFO: Scrape type for 1873026: 2
2026-01-28 20:22:06 [ayvens.be] INFO: Extracting data for car ID: 1873026
2026-01-28 20:22:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a1115b-5a73-5376-b580-fd78c16d816a with identifier: 1873026
2026-01-28 20:22:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a1115b-5a73-5376-b580-fd78c16d816a with scrape type 2
2026-01-28 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a1115b-5a73-5376-b580-fd78c16d816a with scrape type 2
2026-01-28 20:22:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e3a1115b-5a73-5376-b580-fd78c16d816a, identifier: 1873026
2026-01-28 20:22:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e3a1115b-5a73-5376-b580-fd78c16d816a with identifier: 1873026
2026-01-28 20:22:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e3a1115b-5a73-5376-b580-fd78c16d816a with identifier: 1873026
2026-01-28 20:22:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e3a1115b-5a73-5376-b580-fd78c16d816a with identifier: 1873026 to the API
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e3a1115b-5a73-5376-b580-fd78c16d816a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 112714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition Sport S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition Sport S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873026%27 HTTP/1.1" 200 None
2026-01-28 20:22:07 [ayvens.be] INFO: Saving data for 1873026: {'auction_closing_time': 1769761800.0, 'created_time': 1769457802.1692, 'last_price_update_time': 1769631727.354804}
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873026') HTTP/1.1" 204 0
2026-01-28 20:22:07 [ayvens.be] INFO: Found listing with ID: 1873027
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873027%27 HTTP/1.1" 200 None
2026-01-28 20:22:07 [ayvens.be] INFO: Scrape type for 1873027: 2
2026-01-28 20:22:07 [ayvens.be] INFO: Extracting data for car ID: 1873027
2026-01-28 20:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726cc093-1b4d-51f5-995e-3123b19a9842 with identifier: 1873027
2026-01-28 20:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726cc093-1b4d-51f5-995e-3123b19a9842 with scrape type 2
2026-01-28 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726cc093-1b4d-51f5-995e-3123b19a9842 with scrape type 2
2026-01-28 20:22:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 726cc093-1b4d-51f5-995e-3123b19a9842, identifier: 1873027
2026-01-28 20:22:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 726cc093-1b4d-51f5-995e-3123b19a9842 with identifier: 1873027
2026-01-28 20:22:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 726cc093-1b4d-51f5-995e-3123b19a9842 with identifier: 1873027
2026-01-28 20:22:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 726cc093-1b4d-51f5-995e-3123b19a9842 with identifier: 1873027 to the API
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '726cc093-1b4d-51f5-995e-3123b19a9842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3',
 'odometer': 47956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 XDRIVE30E (135KW) AUTO',
 'transmission': 'automatic',
 'trim': '2.0 XDRIVE30E (135KW) AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873027%27 HTTP/1.1" 200 None
2026-01-28 20:22:07 [ayvens.be] INFO: Saving data for 1873027: {'auction_closing_time': 1769761800.0, 'created_time': 1769457802.585375, 'last_price_update_time': 1769631727.744687}
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873027') HTTP/1.1" 204 0
2026-01-28 20:22:07 [ayvens.be] INFO: Found listing with ID: 1873028
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873028%27 HTTP/1.1" 200 None
2026-01-28 20:22:07 [ayvens.be] INFO: Scrape type for 1873028: 2
2026-01-28 20:22:07 [ayvens.be] INFO: Extracting data for car ID: 1873028
2026-01-28 20:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c737d50-b94c-569a-b507-065eeb50c5fd with identifier: 1873028
2026-01-28 20:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c737d50-b94c-569a-b507-065eeb50c5fd with scrape type 2
2026-01-28 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c737d50-b94c-569a-b507-065eeb50c5fd with scrape type 2
2026-01-28 20:22:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2c737d50-b94c-569a-b507-065eeb50c5fd, identifier: 1873028
2026-01-28 20:22:07 [scrapy.extensions.logstats] INFO: Crawled 5 pages (at -1 pages/min), scraped 184 items (at 55 items/min)
2026-01-28 20:22:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2c737d50-b94c-569a-b507-065eeb50c5fd with identifier: 1873028
2026-01-28 20:22:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2c737d50-b94c-569a-b507-065eeb50c5fd with identifier: 1873028
2026-01-28 20:22:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143806 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143806
2026-01-28 20:22:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2c737d50-b94c-569a-b507-065eeb50c5fd spider: ayvens.be
2026-01-28 20:22:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 2c737d50-b94c-569a-b507-065eeb50c5fd due to rule: high_mileage_for_country.json, error: 143806 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143806
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2c737d50-b94c-569a-b507-065eeb50c5fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 SW',
 'odometer': 143806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 SW 1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 130 S&S AUTO ALLURE PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873028%27 HTTP/1.1" 200 None
2026-01-28 20:22:08 [ayvens.be] INFO: Saving data for 1873028: {'auction_closing_time': 1769761800.0, 'created_time': 1769458358.894603, 'last_price_update_time': 1769631728.103365}
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873028') HTTP/1.1" 204 0
2026-01-28 20:22:08 [ayvens.be] INFO: Found listing with ID: 1873029
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873029%27 HTTP/1.1" 200 None
2026-01-28 20:22:08 [ayvens.be] INFO: Scrape type for 1873029: 2
2026-01-28 20:22:08 [ayvens.be] INFO: Extracting data for car ID: 1873029
2026-01-28 20:22:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with identifier: 1873029
2026-01-28 20:22:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with scrape type 2
2026-01-28 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with scrape type 2
2026-01-28 20:22:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f, identifier: 1873029
2026-01-28 20:22:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with identifier: 1873029
2026-01-28 20:22:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with identifier: 1873029
2026-01-28 20:22:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e1597ac-0c60-5b9c-9255-a5ab444dfe4f with identifier: 1873029 to the API
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1e1597ac-0c60-5b9c-9255-a5ab444dfe4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'HYUNDAI',
 'model': 'Tucson',
 'odometer': 74096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'HYUNDAI Tucson 1.6 T-GDI PHEV 4WD SHINE AUTO',
 'transmission': 'automatic',
 'trim': '1.6 T-GDI PHEV 4WD SHINE AUTO',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873029%27 HTTP/1.1" 200 None
2026-01-28 20:22:08 [ayvens.be] INFO: Saving data for 1873029: {'auction_closing_time': 1769761800.0, 'created_time': 1769458354.561258, 'last_price_update_time': 1769631728.610343}
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873029') HTTP/1.1" 204 0
2026-01-28 20:22:08 [ayvens.be] INFO: Found listing with ID: 1873030
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873030%27 HTTP/1.1" 200 None
2026-01-28 20:22:08 [ayvens.be] INFO: Scrape type for 1873030: 2
2026-01-28 20:22:08 [ayvens.be] INFO: Extracting data for car ID: 1873030
2026-01-28 20:22:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with identifier: 1873030
2026-01-28 20:22:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with scrape type 2
2026-01-28 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with scrape type 2
2026-01-28 20:22:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 3bd4158a-12e3-538a-9e0d-23fb088b7d1f, identifier: 1873030
2026-01-28 20:22:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with identifier: 1873030
2026-01-28 20:22:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with identifier: 1873030
2026-01-28 20:22:08 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 3bd4158a-12e3-538a-9e0d-23fb088b7d1f with identifier: 1873030 to the API
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': '3bd4158a-12e3-538a-9e0d-23fb088b7d1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'LEAF e+',
 'odometer': 52330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN LEAF e+ 62 kWh N-Connecta EX POLICE',
 'transmission': 'automatic',
 'trim': '62 kWh N-Connecta EX POLICE',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873030%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Saving data for 1873030: {'auction_closing_time': 1769761800.0, 'created_time': 1769458356.516005, 'last_price_update_time': 1769631729.021318}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873030') HTTP/1.1" 204 0
2026-01-28 20:22:09 [ayvens.be] INFO: Found listing with ID: 1873031
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873031%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Scrape type for 1873031: 2
2026-01-28 20:22:09 [ayvens.be] INFO: Extracting data for car ID: 1873031
2026-01-28 20:22:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with identifier: 1873031
2026-01-28 20:22:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with scrape type 2
2026-01-28 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with scrape type 2
2026-01-28 20:22:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 901d4252-35a8-5ded-a31d-28b5cbaa7a15, identifier: 1873031
2026-01-28 20:22:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with identifier: 1873031
2026-01-28 20:22:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with identifier: 1873031
2026-01-28 20:22:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 901d4252-35a8-5ded-a31d-28b5cbaa7a15 with identifier: 1873031 to the API
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '901d4252-35a8-5ded-a31d-28b5cbaa7a15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 66938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873031%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Saving data for 1873031: {'auction_closing_time': 1769761800.0, 'created_time': 1769458356.974055, 'last_price_update_time': 1769631729.439257}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873031') HTTP/1.1" 204 0
2026-01-28 20:22:09 [ayvens.be] INFO: Found listing with ID: 1873032
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873032%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Scrape type for 1873032: 2
2026-01-28 20:22:09 [ayvens.be] INFO: Extracting data for car ID: 1873032
2026-01-28 20:22:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38fe038-0b2e-56ec-89c2-d8fb88f8925c with identifier: 1873032
2026-01-28 20:22:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38fe038-0b2e-56ec-89c2-d8fb88f8925c with scrape type 2
2026-01-28 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38fe038-0b2e-56ec-89c2-d8fb88f8925c with scrape type 2
2026-01-28 20:22:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a38fe038-0b2e-56ec-89c2-d8fb88f8925c, identifier: 1873032
2026-01-28 20:22:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a38fe038-0b2e-56ec-89c2-d8fb88f8925c with identifier: 1873032
2026-01-28 20:22:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a38fe038-0b2e-56ec-89c2-d8fb88f8925c with identifier: 1873032
2026-01-28 20:22:09 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a38fe038-0b2e-56ec-89c2-d8fb88f8925c with identifier: 1873032 to the API
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'a38fe038-0b2e-56ec-89c2-d8fb88f8925c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q2',
 'odometer': 55551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q2 30 TFSI (EU6d-TEMP)',
 'transmission': 'manual',
 'trim': '30 TFSI (EU6d-TEMP)',
 'vin': None,
 'year': 2019}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873032%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Saving data for 1873032: {'auction_closing_time': 1769761800.0, 'created_time': 1769458353.350573, 'last_price_update_time': 1769631729.845165}
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873032') HTTP/1.1" 204 0
2026-01-28 20:22:09 [ayvens.be] INFO: Found listing with ID: 1873033
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873033%27 HTTP/1.1" 200 None
2026-01-28 20:22:09 [ayvens.be] INFO: Scrape type for 1873033: 2
2026-01-28 20:22:09 [ayvens.be] INFO: Extracting data for car ID: 1873033
2026-01-28 20:22:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8af40b6-774a-5970-bbad-75b27640cae4 with identifier: 1873033
2026-01-28 20:22:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8af40b6-774a-5970-bbad-75b27640cae4 with scrape type 2
2026-01-28 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8af40b6-774a-5970-bbad-75b27640cae4 with scrape type 2
2026-01-28 20:22:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b8af40b6-774a-5970-bbad-75b27640cae4, identifier: 1873033
2026-01-28 20:22:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b8af40b6-774a-5970-bbad-75b27640cae4 with identifier: 1873033
2026-01-28 20:22:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b8af40b6-774a-5970-bbad-75b27640cae4 with identifier: 1873033
2026-01-28 20:22:10 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b8af40b6-774a-5970-bbad-75b27640cae4 with identifier: 1873033 to the API
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b8af40b6-774a-5970-bbad-75b27640cae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 61294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873033%27 HTTP/1.1" 200 None
2026-01-28 20:22:10 [ayvens.be] INFO: Saving data for 1873033: {'auction_closing_time': 1769761800.0, 'created_time': 1769458352.927609, 'last_price_update_time': 1769631730.271576}
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873033') HTTP/1.1" 204 0
2026-01-28 20:22:10 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-01-28 20:22:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:22:12 [ayvens.be] INFO: Found listing with ID: 1873034
2026-01-28 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873034%27 HTTP/1.1" 200 None
2026-01-28 20:22:12 [ayvens.be] INFO: Scrape type for 1873034: 2
2026-01-28 20:22:12 [ayvens.be] INFO: Extracting data for car ID: 1873034
2026-01-28 20:22:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with identifier: 1873034
2026-01-28 20:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with scrape type 2
2026-01-28 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with scrape type 2
2026-01-28 20:22:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7d7018c3-5b8d-5f1c-ae11-1b0430b56062, identifier: 1873034
2026-01-28 20:22:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with identifier: 1873034
2026-01-28 20:22:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with identifier: 1873034
2026-01-28 20:22:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7d7018c3-5b8d-5f1c-ae11-1b0430b56062 with identifier: 1873034 to the API
2026-01-28 20:22:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7d7018c3-5b8d-5f1c-ae11-1b0430b56062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'PUMA',
 'odometer': 58974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD PUMA 1.0 ECOBOOST MHEV 92KW TITANIUM',
 'transmission': 'manual',
 'trim': '1.0 ECOBOOST MHEV 92KW TITANIUM',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873034%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Saving data for 1873034: {'auction_closing_time': 1769761800.0, 'created_time': 1769458350.347811, 'last_price_update_time': 1769631733.099543}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873034') HTTP/1.1" 204 0
2026-01-28 20:22:13 [ayvens.be] INFO: Found listing with ID: 1873035
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873035%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Scrape type for 1873035: 2
2026-01-28 20:22:13 [ayvens.be] INFO: Extracting data for car ID: 1873035
2026-01-28 20:22:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d4a194-1cea-5a34-87a9-0272ceb9d738 with identifier: 1873035
2026-01-28 20:22:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d4a194-1cea-5a34-87a9-0272ceb9d738 with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d4a194-1cea-5a34-87a9-0272ceb9d738 with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86d4a194-1cea-5a34-87a9-0272ceb9d738, identifier: 1873035
2026-01-28 20:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86d4a194-1cea-5a34-87a9-0272ceb9d738 with identifier: 1873035
2026-01-28 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86d4a194-1cea-5a34-87a9-0272ceb9d738 with identifier: 1873035
2026-01-28 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 128477 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    128477
2026-01-28 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 86d4a194-1cea-5a34-87a9-0272ceb9d738 spider: ayvens.be
2026-01-28 20:22:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 86d4a194-1cea-5a34-87a9-0272ceb9d738 due to rule: high_mileage_for_country.json, error: 128477 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    128477
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '86d4a194-1cea-5a34-87a9-0272ceb9d738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 128477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 3008 1.5 BLUEHDI S&S EAT8 CROSSWAY',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI S&S EAT8 CROSSWAY',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873035%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Saving data for 1873035: {'auction_closing_time': 1769761800.0, 'created_time': 1769458348.501409, 'last_price_update_time': 1769631733.429147}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873035') HTTP/1.1" 204 0
2026-01-28 20:22:13 [ayvens.be] INFO: Found listing with ID: 1873036
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873036%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Scrape type for 1873036: 2
2026-01-28 20:22:13 [ayvens.be] INFO: Extracting data for car ID: 1873036
2026-01-28 20:22:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e509d9-d2cf-5844-ab59-77cfd89c632e with identifier: 1873036
2026-01-28 20:22:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72e509d9-d2cf-5844-ab59-77cfd89c632e with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72e509d9-d2cf-5844-ab59-77cfd89c632e with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 72e509d9-d2cf-5844-ab59-77cfd89c632e, identifier: 1873036
2026-01-28 20:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 72e509d9-d2cf-5844-ab59-77cfd89c632e with identifier: 1873036
2026-01-28 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 72e509d9-d2cf-5844-ab59-77cfd89c632e with identifier: 1873036
2026-01-28 20:22:13 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 72e509d9-d2cf-5844-ab59-77cfd89c632e with identifier: 1873036 to the API
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '72e509d9-d2cf-5844-ab59-77cfd89c632e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 112432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.5 BLUEHDI 130 ACTIVE PACK',
 'transmission': 'manual',
 'trim': '1.5 BLUEHDI 130 ACTIVE PACK',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873036%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Saving data for 1873036: {'auction_closing_time': 1769761800.0, 'created_time': 1769458346.459555, 'last_price_update_time': 1769631733.815559}
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873036') HTTP/1.1" 204 0
2026-01-28 20:22:13 [ayvens.be] INFO: Found listing with ID: 1873037
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873037%27 HTTP/1.1" 200 None
2026-01-28 20:22:13 [ayvens.be] INFO: Scrape type for 1873037: 2
2026-01-28 20:22:13 [ayvens.be] INFO: Extracting data for car ID: 1873037
2026-01-28 20:22:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with identifier: 1873037
2026-01-28 20:22:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with scrape type 2
2026-01-28 20:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 08b7f9aa-c906-5bc7-8513-dbdd51c8d132, identifier: 1873037
2026-01-28 20:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with identifier: 1873037
2026-01-28 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with identifier: 1873037
2026-01-28 20:22:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 08b7f9aa-c906-5bc7-8513-dbdd51c8d132 with identifier: 1873037 to the API
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '08b7f9aa-c906-5bc7-8513-dbdd51c8d132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 117757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 2.0 TDI 115 MOVE!',
 'transmission': 'manual',
 'trim': '2.0 TDI 115 MOVE!',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873037%27 HTTP/1.1" 200 None
2026-01-28 20:22:14 [ayvens.be] INFO: Saving data for 1873037: {'auction_closing_time': 1769761800.0, 'created_time': 1769458342.815213, 'last_price_update_time': 1769631734.213791}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873037') HTTP/1.1" 204 0
2026-01-28 20:22:14 [ayvens.be] INFO: Found listing with ID: 1873038
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873038%27 HTTP/1.1" 200 None
2026-01-28 20:22:14 [ayvens.be] INFO: Scrape type for 1873038: 2
2026-01-28 20:22:14 [ayvens.be] INFO: Extracting data for car ID: 1873038
2026-01-28 20:22:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b107b4ab-f1e7-535a-b58f-5115c2639746 with identifier: 1873038
2026-01-28 20:22:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b107b4ab-f1e7-535a-b58f-5115c2639746 with scrape type 2
2026-01-28 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b107b4ab-f1e7-535a-b58f-5115c2639746 with scrape type 2
2026-01-28 20:22:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b107b4ab-f1e7-535a-b58f-5115c2639746, identifier: 1873038
2026-01-28 20:22:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b107b4ab-f1e7-535a-b58f-5115c2639746 with identifier: 1873038
2026-01-28 20:22:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b107b4ab-f1e7-535a-b58f-5115c2639746 with identifier: 1873038
2026-01-28 20:22:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163995 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    163995
2026-01-28 20:22:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b107b4ab-f1e7-535a-b58f-5115c2639746 spider: ayvens.be
2026-01-28 20:22:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: b107b4ab-f1e7-535a-b58f-5115c2639746 due to rule: high_mileage_for_country.json, error: 163995 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    163995
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'b107b4ab-f1e7-535a-b58f-5115c2639746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VII DIESEL - 2017',
 'odometer': 163995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VII DIESEL - 2017 1.6 SCR TDi Trendline (EU6.2) '
          'STOCK',
 'transmission': 'manual',
 'trim': '1.6 SCR TDi Trendline (EU6.2) STOCK',
 'vin': None,
 'year': 2019}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873038%27 HTTP/1.1" 200 None
2026-01-28 20:22:14 [ayvens.be] INFO: Saving data for 1873038: {'auction_closing_time': 1769761800.0, 'created_time': 1769458343.145832, 'last_price_update_time': 1769631734.542184}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873038') HTTP/1.1" 204 0
2026-01-28 20:22:14 [ayvens.be] INFO: Found listing with ID: 1873039
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873039%27 HTTP/1.1" 200 None
2026-01-28 20:22:14 [ayvens.be] INFO: Scrape type for 1873039: 2
2026-01-28 20:22:14 [ayvens.be] INFO: Extracting data for car ID: 1873039
2026-01-28 20:22:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a35c553-d52e-5b1a-a446-930928e65dcc with identifier: 1873039
2026-01-28 20:22:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a35c553-d52e-5b1a-a446-930928e65dcc with scrape type 2
2026-01-28 20:22:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a35c553-d52e-5b1a-a446-930928e65dcc with scrape type 2
2026-01-28 20:22:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5a35c553-d52e-5b1a-a446-930928e65dcc, identifier: 1873039
2026-01-28 20:22:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5a35c553-d52e-5b1a-a446-930928e65dcc with identifier: 1873039
2026-01-28 20:22:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5a35c553-d52e-5b1a-a446-930928e65dcc with identifier: 1873039
2026-01-28 20:22:14 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5a35c553-d52e-5b1a-a446-930928e65dcc with identifier: 1873039 to the API
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '5a35c553-d52e-5b1a-a446-930928e65dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 65195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873039%27 HTTP/1.1" 200 None
2026-01-28 20:22:14 [ayvens.be] INFO: Saving data for 1873039: {'auction_closing_time': 1769761800.0, 'created_time': 1769457878.460321, 'last_price_update_time': 1769631734.930036}
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873039') HTTP/1.1" 204 0
2026-01-28 20:22:15 [ayvens.be] INFO: Found listing with ID: 1873040
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873040%27 HTTP/1.1" 200 None
2026-01-28 20:22:15 [ayvens.be] INFO: Scrape type for 1873040: 2
2026-01-28 20:22:15 [ayvens.be] INFO: Extracting data for car ID: 1873040
2026-01-28 20:22:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8db5cec7-daee-5c26-8d70-5b6ab12ee649 with identifier: 1873040
2026-01-28 20:22:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8db5cec7-daee-5c26-8d70-5b6ab12ee649 with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8db5cec7-daee-5c26-8d70-5b6ab12ee649 with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8db5cec7-daee-5c26-8d70-5b6ab12ee649, identifier: 1873040
2026-01-28 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8db5cec7-daee-5c26-8d70-5b6ab12ee649 with identifier: 1873040
2026-01-28 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8db5cec7-daee-5c26-8d70-5b6ab12ee649 with identifier: 1873040
2026-01-28 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350m fou mwb hr dsl' containing 'transit'
2026-01-28 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8db5cec7-daee-5c26-8d70-5b6ab12ee649 spider: ayvens.be
2026-01-28 20:22:15 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8db5cec7-daee-5c26-8d70-5b6ab12ee649 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350m fou mwb hr dsl' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'FROZEN WHITE',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '8db5cec7-daee-5c26-8d70-5b6ab12ee649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 35502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend STOCK',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend STOCK',
 'vin': None,
 'year': 2018}
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873040%27 HTTP/1.1" 200 None
2026-01-28 20:22:15 [ayvens.be] INFO: Saving data for 1873040: {'auction_closing_time': 1769761800.0, 'created_time': 1769458339.131473, 'last_price_update_time': 1769631735.358639}
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873040') HTTP/1.1" 204 0
2026-01-28 20:22:15 [ayvens.be] INFO: Found listing with ID: 1873041
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873041%27 HTTP/1.1" 200 None
2026-01-28 20:22:15 [ayvens.be] INFO: Scrape type for 1873041: 2
2026-01-28 20:22:15 [ayvens.be] INFO: Extracting data for car ID: 1873041
2026-01-28 20:22:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b6bca1a-3876-55d9-b8e2-a905c35957bb with identifier: 1873041
2026-01-28 20:22:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b6bca1a-3876-55d9-b8e2-a905c35957bb with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b6bca1a-3876-55d9-b8e2-a905c35957bb with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4b6bca1a-3876-55d9-b8e2-a905c35957bb, identifier: 1873041
2026-01-28 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4b6bca1a-3876-55d9-b8e2-a905c35957bb with identifier: 1873041
2026-01-28 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4b6bca1a-3876-55d9-b8e2-a905c35957bb with identifier: 1873041
2026-01-28 20:22:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4b6bca1a-3876-55d9-b8e2-a905c35957bb with identifier: 1873041 to the API
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4b6bca1a-3876-55d9-b8e2-a905c35957bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 56417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873041%27 HTTP/1.1" 200 None
2026-01-28 20:22:15 [ayvens.be] INFO: Saving data for 1873041: {'auction_closing_time': 1769761800.0, 'created_time': 1769458336.110775, 'last_price_update_time': 1769631735.751139}
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873041') HTTP/1.1" 204 0
2026-01-28 20:22:15 [ayvens.be] INFO: Found listing with ID: 1873042
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873042%27 HTTP/1.1" 200 None
2026-01-28 20:22:15 [ayvens.be] INFO: Scrape type for 1873042: 2
2026-01-28 20:22:15 [ayvens.be] INFO: Extracting data for car ID: 1873042
2026-01-28 20:22:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4886f92-0659-52df-8e78-caab6cf80896 with identifier: 1873042
2026-01-28 20:22:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4886f92-0659-52df-8e78-caab6cf80896 with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4886f92-0659-52df-8e78-caab6cf80896 with scrape type 2
2026-01-28 20:22:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c4886f92-0659-52df-8e78-caab6cf80896, identifier: 1873042
2026-01-28 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c4886f92-0659-52df-8e78-caab6cf80896 with identifier: 1873042
2026-01-28 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c4886f92-0659-52df-8e78-caab6cf80896 with identifier: 1873042
2026-01-28 20:22:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c4886f92-0659-52df-8e78-caab6cf80896 with identifier: 1873042 to the API
2026-01-28 20:22:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c4886f92-0659-52df-8e78-caab6cf80896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 - 2019',
 'odometer': 54652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 - 2019 1.5iA sDrive18 OPF',
 'transmission': 'automatic',
 'trim': '1.5iA sDrive18 OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873042%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Saving data for 1873042: {'auction_closing_time': 1769761800.0, 'created_time': 1769458333.678851, 'last_price_update_time': 1769631736.13508}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873042') HTTP/1.1" 204 0
2026-01-28 20:22:16 [ayvens.be] INFO: Found listing with ID: 1873043
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873043%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Scrape type for 1873043: 2
2026-01-28 20:22:16 [ayvens.be] INFO: Extracting data for car ID: 1873043
2026-01-28 20:22:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b65011-afd0-51d6-abf0-1b8027105cf6 with identifier: 1873043
2026-01-28 20:22:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b65011-afd0-51d6-abf0-1b8027105cf6 with scrape type 2
2026-01-28 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b65011-afd0-51d6-abf0-1b8027105cf6 with scrape type 2
2026-01-28 20:22:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 58b65011-afd0-51d6-abf0-1b8027105cf6, identifier: 1873043
2026-01-28 20:22:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 58b65011-afd0-51d6-abf0-1b8027105cf6 with identifier: 1873043
2026-01-28 20:22:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 58b65011-afd0-51d6-abf0-1b8027105cf6 with identifier: 1873043
2026-01-28 20:22:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 58b65011-afd0-51d6-abf0-1b8027105cf6 with identifier: 1873043 to the API
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '58b65011-afd0-51d6-abf0-1b8027105cf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 100171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873043%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Saving data for 1873043: {'auction_closing_time': 1769761800.0, 'created_time': 1769458332.493918, 'last_price_update_time': 1769631736.521401}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873043') HTTP/1.1" 204 0
2026-01-28 20:22:16 [ayvens.be] INFO: Found listing with ID: 1873044
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873044%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Scrape type for 1873044: 2
2026-01-28 20:22:16 [ayvens.be] INFO: Extracting data for car ID: 1873044
2026-01-28 20:22:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36b79d2-14e6-584e-94c1-8a7b109d3923 with identifier: 1873044
2026-01-28 20:22:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36b79d2-14e6-584e-94c1-8a7b109d3923 with scrape type 2
2026-01-28 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36b79d2-14e6-584e-94c1-8a7b109d3923 with scrape type 2
2026-01-28 20:22:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e36b79d2-14e6-584e-94c1-8a7b109d3923, identifier: 1873044
2026-01-28 20:22:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e36b79d2-14e6-584e-94c1-8a7b109d3923 with identifier: 1873044
2026-01-28 20:22:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e36b79d2-14e6-584e-94c1-8a7b109d3923 with identifier: 1873044
2026-01-28 20:22:16 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e36b79d2-14e6-584e-94c1-8a7b109d3923 with identifier: 1873044 to the API
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e36b79d2-14e6-584e-94c1-8a7b109d3923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLB',
 'odometer': 124367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLB 2.0 GLB 220 D DCT',
 'transmission': 'automatic',
 'trim': '2.0 GLB 220 D DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873044%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Saving data for 1873044: {'auction_closing_time': 1769761800.0, 'created_time': 1769458329.724566, 'last_price_update_time': 1769631736.933874}
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873044') HTTP/1.1" 204 0
2026-01-28 20:22:16 [ayvens.be] INFO: Found listing with ID: 1873045
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873045%27 HTTP/1.1" 200 None
2026-01-28 20:22:16 [ayvens.be] INFO: Scrape type for 1873045: 2
2026-01-28 20:22:16 [ayvens.be] INFO: Extracting data for car ID: 1873045
2026-01-28 20:22:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with identifier: 1873045
2026-01-28 20:22:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with scrape type 2
2026-01-28 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with scrape type 2
2026-01-28 20:22:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: edaa08e3-0514-59ba-8722-6f4fbc2eb5c3, identifier: 1873045
2026-01-28 20:22:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with identifier: 1873045
2026-01-28 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with identifier: 1873045
2026-01-28 20:22:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: edaa08e3-0514-59ba-8722-6f4fbc2eb5c3 with identifier: 1873045 to the API
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'edaa08e3-0514-59ba-8722-6f4fbc2eb5c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X2 DIESEL',
 'odometer': 118468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 DIESEL 1.5 dA sDrive16',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16',
 'vin': None,
 'year': 2019}
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873045%27 HTTP/1.1" 200 None
2026-01-28 20:22:17 [ayvens.be] INFO: Saving data for 1873045: {'auction_closing_time': 1769761800.0, 'created_time': 1769458323.691413, 'last_price_update_time': 1769631737.312805}
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873045') HTTP/1.1" 204 0
2026-01-28 20:22:17 [ayvens.be] INFO: Found listing with ID: 1873046
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873046%27 HTTP/1.1" 200 None
2026-01-28 20:22:17 [ayvens.be] INFO: Scrape type for 1873046: 2
2026-01-28 20:22:17 [ayvens.be] INFO: Extracting data for car ID: 1873046
2026-01-28 20:22:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ab229f-15e3-5069-b202-d787b4384a82 with identifier: 1873046
2026-01-28 20:22:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ab229f-15e3-5069-b202-d787b4384a82 with scrape type 2
2026-01-28 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68ab229f-15e3-5069-b202-d787b4384a82 with scrape type 2
2026-01-28 20:22:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 68ab229f-15e3-5069-b202-d787b4384a82, identifier: 1873046
2026-01-28 20:22:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 68ab229f-15e3-5069-b202-d787b4384a82 with identifier: 1873046
2026-01-28 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 68ab229f-15e3-5069-b202-d787b4384a82 with identifier: 1873046
2026-01-28 20:22:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 68ab229f-15e3-5069-b202-d787b4384a82 with identifier: 1873046 to the API
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '68ab229f-15e3-5069-b202-d787b4384a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 43176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873046%27 HTTP/1.1" 200 None
2026-01-28 20:22:17 [ayvens.be] INFO: Saving data for 1873046: {'auction_closing_time': 1769761800.0, 'created_time': 1769458325.732665, 'last_price_update_time': 1769631737.719666}
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873046') HTTP/1.1" 204 0
2026-01-28 20:22:17 [ayvens.be] INFO: Found listing with ID: 1873047
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873047%27 HTTP/1.1" 200 None
2026-01-28 20:22:17 [ayvens.be] INFO: Scrape type for 1873047: 2
2026-01-28 20:22:17 [ayvens.be] INFO: Extracting data for car ID: 1873047
2026-01-28 20:22:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73f556d-d259-5922-a9c9-b178efdfa9c8 with identifier: 1873047
2026-01-28 20:22:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73f556d-d259-5922-a9c9-b178efdfa9c8 with scrape type 2
2026-01-28 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d73f556d-d259-5922-a9c9-b178efdfa9c8 with scrape type 2
2026-01-28 20:22:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d73f556d-d259-5922-a9c9-b178efdfa9c8, identifier: 1873047
2026-01-28 20:22:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d73f556d-d259-5922-a9c9-b178efdfa9c8 with identifier: 1873047
2026-01-28 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d73f556d-d259-5922-a9c9-b178efdfa9c8 with identifier: 1873047
2026-01-28 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148590 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148590
2026-01-28 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d73f556d-d259-5922-a9c9-b178efdfa9c8 spider: ayvens.be
2026-01-28 20:22:18 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: d73f556d-d259-5922-a9c9-b178efdfa9c8 due to rule: high_mileage_for_country.json, error: 148590 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    148590
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd73f556d-d259-5922-a9c9-b178efdfa9c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 SPORTBACK',
 'odometer': 148590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 SPORTBACK 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873047%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Saving data for 1873047: {'auction_closing_time': 1769761800.0, 'created_time': 1769458321.540495, 'last_price_update_time': 1769631738.097777}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873047') HTTP/1.1" 204 0
2026-01-28 20:22:18 [ayvens.be] INFO: Found listing with ID: 1873048
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873048%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Scrape type for 1873048: 2
2026-01-28 20:22:18 [ayvens.be] INFO: Extracting data for car ID: 1873048
2026-01-28 20:22:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d271f43d-df23-5059-95e8-0065d8f8006f with identifier: 1873048
2026-01-28 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d271f43d-df23-5059-95e8-0065d8f8006f with scrape type 2
2026-01-28 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d271f43d-df23-5059-95e8-0065d8f8006f with scrape type 2
2026-01-28 20:22:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: d271f43d-df23-5059-95e8-0065d8f8006f, identifier: 1873048
2026-01-28 20:22:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: d271f43d-df23-5059-95e8-0065d8f8006f with identifier: 1873048
2026-01-28 20:22:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: d271f43d-df23-5059-95e8-0065d8f8006f with identifier: 1873048
2026-01-28 20:22:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: d271f43d-df23-5059-95e8-0065d8f8006f with identifier: 1873048 to the API
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'd271f43d-df23-5059-95e8-0065d8f8006f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 84535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA 1.3 GLA 250 E DCT BUSINESS LINE',
 'transmission': 'automatic',
 'trim': '1.3 GLA 250 E DCT BUSINESS LINE',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873048%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Saving data for 1873048: {'auction_closing_time': 1769761800.0, 'created_time': 1769457933.362992, 'last_price_update_time': 1769631738.50363}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873048') HTTP/1.1" 204 0
2026-01-28 20:22:18 [ayvens.be] INFO: Found listing with ID: 1873049
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873049%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Scrape type for 1873049: 2
2026-01-28 20:22:18 [ayvens.be] INFO: Extracting data for car ID: 1873049
2026-01-28 20:22:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba3cb842-2eea-5a53-be3b-f604f5370c7c with identifier: 1873049
2026-01-28 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba3cb842-2eea-5a53-be3b-f604f5370c7c with scrape type 2
2026-01-28 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba3cb842-2eea-5a53-be3b-f604f5370c7c with scrape type 2
2026-01-28 20:22:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ba3cb842-2eea-5a53-be3b-f604f5370c7c, identifier: 1873049
2026-01-28 20:22:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ba3cb842-2eea-5a53-be3b-f604f5370c7c with identifier: 1873049
2026-01-28 20:22:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ba3cb842-2eea-5a53-be3b-f604f5370c7c with identifier: 1873049
2026-01-28 20:22:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ba3cb842-2eea-5a53-be3b-f604f5370c7c with identifier: 1873049 to the API
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 48,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ba3cb842-2eea-5a53-be3b-f604f5370c7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 100112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873049%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Saving data for 1873049: {'auction_closing_time': 1769761800.0, 'created_time': 1769457939.578659, 'last_price_update_time': 1769631738.887258}
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873049') HTTP/1.1" 204 0
2026-01-28 20:22:18 [ayvens.be] INFO: Found listing with ID: 1873050
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873050%27 HTTP/1.1" 200 None
2026-01-28 20:22:18 [ayvens.be] INFO: Scrape type for 1873050: 2
2026-01-28 20:22:18 [ayvens.be] INFO: Extracting data for car ID: 1873050
2026-01-28 20:22:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4057a2a4-8316-5012-afb8-5853fbdbe5f9 with identifier: 1873050
2026-01-28 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4057a2a4-8316-5012-afb8-5853fbdbe5f9 with scrape type 2
2026-01-28 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4057a2a4-8316-5012-afb8-5853fbdbe5f9 with scrape type 2
2026-01-28 20:22:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4057a2a4-8316-5012-afb8-5853fbdbe5f9, identifier: 1873050
2026-01-28 20:22:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4057a2a4-8316-5012-afb8-5853fbdbe5f9 with identifier: 1873050
2026-01-28 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4057a2a4-8316-5012-afb8-5853fbdbe5f9 with identifier: 1873050
2026-01-28 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146254 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146254
2026-01-28 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4057a2a4-8316-5012-afb8-5853fbdbe5f9 spider: ayvens.be
2026-01-28 20:22:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 4057a2a4-8316-5012-afb8-5853fbdbe5f9 due to rule: high_mileage_for_country.json, error: 146254 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    146254
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '4057a2a4-8316-5012-afb8-5853fbdbe5f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A4 AVANT DIESEL - 2020',
 'odometer': 146254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A4 AVANT DIESEL - 2020 30 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '30 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873050%27 HTTP/1.1" 200 None
2026-01-28 20:22:19 [ayvens.be] INFO: Saving data for 1873050: {'auction_closing_time': 1769761800.0, 'created_time': 1769458320.392401, 'last_price_update_time': 1769631739.249108}
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873050') HTTP/1.1" 204 0
2026-01-28 20:22:19 [ayvens.be] INFO: Found listing with ID: 1873051
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873051%27 HTTP/1.1" 200 None
2026-01-28 20:22:19 [ayvens.be] INFO: Scrape type for 1873051: 2
2026-01-28 20:22:19 [ayvens.be] INFO: Extracting data for car ID: 1873051
2026-01-28 20:22:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with identifier: 1873051
2026-01-28 20:22:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with scrape type 2
2026-01-28 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with scrape type 2
2026-01-28 20:22:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 6ed41934-ab69-5bf6-8e01-0c9aa6da249e, identifier: 1873051
2026-01-28 20:22:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with identifier: 1873051
2026-01-28 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with identifier: 1873051
2026-01-28 20:22:19 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 6ed41934-ab69-5bf6-8e01-0c9aa6da249e with identifier: 1873051 to the API
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '6ed41934-ab69-5bf6-8e01-0c9aa6da249e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLA',
 'odometer': 84036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLA 1.3 GLA 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 GLA 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873051%27 HTTP/1.1" 200 None
2026-01-28 20:22:19 [ayvens.be] INFO: Saving data for 1873051: {'auction_closing_time': 1769761800.0, 'created_time': 1769458318.103897, 'last_price_update_time': 1769631739.831275}
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873051') HTTP/1.1" 204 0
2026-01-28 20:22:19 [ayvens.be] INFO: Found listing with ID: 1873052
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873052%27 HTTP/1.1" 200 None
2026-01-28 20:22:19 [ayvens.be] INFO: Scrape type for 1873052: 2
2026-01-28 20:22:19 [ayvens.be] INFO: Extracting data for car ID: 1873052
2026-01-28 20:22:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f4b462-2273-5c73-b8e1-6a6418d7c788 with identifier: 1873052
2026-01-28 20:22:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f4b462-2273-5c73-b8e1-6a6418d7c788 with scrape type 2
2026-01-28 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92f4b462-2273-5c73-b8e1-6a6418d7c788 with scrape type 2
2026-01-28 20:22:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 92f4b462-2273-5c73-b8e1-6a6418d7c788, identifier: 1873052
2026-01-28 20:22:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 92f4b462-2273-5c73-b8e1-6a6418d7c788 with identifier: 1873052
2026-01-28 20:22:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 92f4b462-2273-5c73-b8e1-6a6418d7c788 with identifier: 1873052
2026-01-28 20:22:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 92f4b462-2273-5c73-b8e1-6a6418d7c788 with identifier: 1873052 to the API
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '92f4b462-2273-5c73-b8e1-6a6418d7c788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 - 2019',
 'odometer': 102364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 - 2019 35 TFSI',
 'transmission': 'manual',
 'trim': '35 TFSI',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873052%27 HTTP/1.1" 200 None
2026-01-28 20:22:20 [ayvens.be] INFO: Saving data for 1873052: {'auction_closing_time': 1769761800.0, 'created_time': 1769458317.281963, 'last_price_update_time': 1769631740.248413}
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873052') HTTP/1.1" 204 0
2026-01-28 20:22:20 [ayvens.be] INFO: Found listing with ID: 1873053
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873053%27 HTTP/1.1" 200 None
2026-01-28 20:22:20 [ayvens.be] INFO: Scrape type for 1873053: 2
2026-01-28 20:22:20 [ayvens.be] INFO: Extracting data for car ID: 1873053
2026-01-28 20:22:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7188d117-b03c-560b-b1d3-3b60a55f9e9c with identifier: 1873053
2026-01-28 20:22:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7188d117-b03c-560b-b1d3-3b60a55f9e9c with scrape type 2
2026-01-28 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7188d117-b03c-560b-b1d3-3b60a55f9e9c with scrape type 2
2026-01-28 20:22:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7188d117-b03c-560b-b1d3-3b60a55f9e9c, identifier: 1873053
2026-01-28 20:22:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7188d117-b03c-560b-b1d3-3b60a55f9e9c with identifier: 1873053
2026-01-28 20:22:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7188d117-b03c-560b-b1d3-3b60a55f9e9c with identifier: 1873053
2026-01-28 20:22:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7188d117-b03c-560b-b1d3-3b60a55f9e9c with identifier: 1873053 to the API
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '7188d117-b03c-560b-b1d3-3b60a55f9e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO V',
 'odometer': 79727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO V 1.0 TCe Corporate Edition (Fleet)',
 'transmission': 'manual',
 'trim': '1.0 TCe Corporate Edition (Fleet)',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873053%27 HTTP/1.1" 200 None
2026-01-28 20:22:20 [ayvens.be] INFO: Saving data for 1873053: {'auction_closing_time': 1769761800.0, 'created_time': 1769458007.870997, 'last_price_update_time': 1769631740.635765}
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873053') HTTP/1.1" 204 0
2026-01-28 20:22:20 [ayvens.be] INFO: Found listing with ID: 1873054
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873054%27 HTTP/1.1" 200 None
2026-01-28 20:22:20 [ayvens.be] INFO: Scrape type for 1873054: 2
2026-01-28 20:22:20 [ayvens.be] INFO: Extracting data for car ID: 1873054
2026-01-28 20:22:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ecfd25d-721b-54d5-9102-7ddff9f381ee with identifier: 1873054
2026-01-28 20:22:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ecfd25d-721b-54d5-9102-7ddff9f381ee with scrape type 2
2026-01-28 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ecfd25d-721b-54d5-9102-7ddff9f381ee with scrape type 2
2026-01-28 20:22:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5ecfd25d-721b-54d5-9102-7ddff9f381ee, identifier: 1873054
2026-01-28 20:22:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5ecfd25d-721b-54d5-9102-7ddff9f381ee with identifier: 1873054
2026-01-28 20:22:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5ecfd25d-721b-54d5-9102-7ddff9f381ee with identifier: 1873054
2026-01-28 20:22:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 5ecfd25d-721b-54d5-9102-7ddff9f381ee with identifier: 1873054 to the API
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '5ecfd25d-721b-54d5-9102-7ddff9f381ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'JEEP',
 'model': 'Renegade',
 'odometer': 102379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'JEEP Renegade 1.3 PHEV T4 190 4WD 80TH',
 'transmission': 'automatic',
 'trim': '1.3 PHEV T4 190 4WD 80TH',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873054%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Saving data for 1873054: {'auction_closing_time': 1769761800.0, 'created_time': 1769457997.845454, 'last_price_update_time': 1769631741.027978}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873054') HTTP/1.1" 204 0
2026-01-28 20:22:21 [ayvens.be] INFO: Found listing with ID: 1873055
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873055%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Scrape type for 1873055: 2
2026-01-28 20:22:21 [ayvens.be] INFO: Extracting data for car ID: 1873055
2026-01-28 20:22:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed0fdda-59b7-502b-8a1a-da3e939ea87f with identifier: 1873055
2026-01-28 20:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed0fdda-59b7-502b-8a1a-da3e939ea87f with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed0fdda-59b7-502b-8a1a-da3e939ea87f with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: fed0fdda-59b7-502b-8a1a-da3e939ea87f, identifier: 1873055
2026-01-28 20:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: fed0fdda-59b7-502b-8a1a-da3e939ea87f with identifier: 1873055
2026-01-28 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: fed0fdda-59b7-502b-8a1a-da3e939ea87f with identifier: 1873055
2026-01-28 20:22:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: fed0fdda-59b7-502b-8a1a-da3e939ea87f with identifier: 1873055 to the API
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 42,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'fed0fdda-59b7-502b-8a1a-da3e939ea87f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC60',
 'odometer': 73515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC60 2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'transmission': 'automatic',
 'trim': '2.0 T6 PHEV INSCRIPTION EXPR. AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873055%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Saving data for 1873055: {'auction_closing_time': 1769761800.0, 'created_time': 1769457978.856402, 'last_price_update_time': 1769631741.436848}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873055') HTTP/1.1" 204 0
2026-01-28 20:22:21 [ayvens.be] INFO: Found listing with ID: 1873056
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873056%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Scrape type for 1873056: 2
2026-01-28 20:22:21 [ayvens.be] INFO: Extracting data for car ID: 1873056
2026-01-28 20:22:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 with identifier: 1873056
2026-01-28 20:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68, identifier: 1873056
2026-01-28 20:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 with identifier: 1873056
2026-01-28 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 with identifier: 1873056
2026-01-28 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'x1 diesel - 2019', 'trim': '1.5 da sdrive16 adblue', 'title': 'bmw x1 diesel - 2019 1.5 da sdrive16 adblue', 'price': 0, 'odometer': 202272, 'odometer_reading_unit': 'km', 'registration_date': '2021-03-05', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68', 'current_year_diff': 5, 'age_in_months': 58, 'make_model': 'bmw x1 diesel - 2019', 'sanitized_make': 'bmw', 'odometer_in_km': 202272}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'diesel',
     'id': 'ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw x1 diesel - 2019',
     'model': 'x1 diesel - 2019',
     'odometer': 202272,
     'odometer_in_km': 202272,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-05',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw x1 diesel - 2019 1.5 da sdrive16 adblue',
     'transmission': 'automatic',
     'trim': '1.5 da sdrive16 adblue',
     'vin': None,
     'year': 2021}
2026-01-28 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 spider: ayvens.be
2026-01-28 20:22:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': 'x1 diesel - 2019', 'trim': '1.5 da sdrive16 adblue', 'title': 'bmw x1 diesel - 2019 1.5 da sdrive16 adblue', 'price': 0, 'odometer': 202272, 'odometer_reading_unit': 'km', 'registration_date': '2021-03-05', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '1.5l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68', 'current_year_diff': 5, 'age_in_months': 58, 'make_model': 'bmw x1 diesel - 2019', 'sanitized_make': 'bmw', 'odometer_in_km': 202272}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 58,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'engine': '1.5l',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'diesel',
     'id': 'ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw x1 diesel - 2019',
     'model': 'x1 diesel - 2019',
     'odometer': 202272,
     'odometer_in_km': 202272,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-05',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw x1 diesel - 2019 1.5 da sdrive16 adblue',
     'transmission': 'automatic',
     'trim': '1.5 da sdrive16 adblue',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'ea0a67c1-d3ef-5aae-8fd9-6c1e9d127d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1 DIESEL - 2019',
 'odometer': 202272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 DIESEL - 2019 1.5 dA sDrive16 AdBlue',
 'transmission': 'automatic',
 'trim': '1.5 dA sDrive16 AdBlue',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873056%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Saving data for 1873056: {'auction_closing_time': 1769761800.0, 'created_time': 1769457995.903812, 'last_price_update_time': 1769631741.764322}
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873056') HTTP/1.1" 204 0
2026-01-28 20:22:21 [ayvens.be] INFO: Found listing with ID: 1873057
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873057%27 HTTP/1.1" 200 None
2026-01-28 20:22:21 [ayvens.be] INFO: Scrape type for 1873057: 2
2026-01-28 20:22:21 [ayvens.be] INFO: Extracting data for car ID: 1873057
2026-01-28 20:22:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with identifier: 1873057
2026-01-28 20:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with scrape type 2
2026-01-28 20:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 03c3da3d-4ebe-53a9-8cef-3432c6ec271d, identifier: 1873057
2026-01-28 20:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with identifier: 1873057
2026-01-28 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with identifier: 1873057
2026-01-28 20:22:21 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 03c3da3d-4ebe-53a9-8cef-3432c6ec271d with identifier: 1873057 to the API
2026-01-28 20:22:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '03c3da3d-4ebe-53a9-8cef-3432c6ec271d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '508 DIESEL - 2018',
 'odometer': 118807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 508 DIESEL - 2018 1.5 BlueHDi Allure S&S',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi Allure S&S',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873057%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Saving data for 1873057: {'auction_closing_time': 1769761800.0, 'created_time': 1769457989.499624, 'last_price_update_time': 1769631742.142238}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873057') HTTP/1.1" 204 0
2026-01-28 20:22:22 [ayvens.be] INFO: Found listing with ID: 1873058
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873058%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Scrape type for 1873058: 2
2026-01-28 20:22:22 [ayvens.be] INFO: Extracting data for car ID: 1873058
2026-01-28 20:22:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 with identifier: 1873058
2026-01-28 20:22:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40, identifier: 1873058
2026-01-28 20:22:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 with identifier: 1873058
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 with identifier: 1873058
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152210 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152210
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 spider: ayvens.be
2026-01-28 20:22:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 33064ca4-0afa-56a3-8d1e-990fbb2e2d40 due to rule: high_mileage_for_country.json, error: 152210 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152210
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '33064ca4-0afa-56a3-8d1e-990fbb2e2d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 152210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873058%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Saving data for 1873058: {'auction_closing_time': 1769761800.0, 'created_time': 1769457995.639218, 'last_price_update_time': 1769631742.493064}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873058') HTTP/1.1" 204 0
2026-01-28 20:22:22 [ayvens.be] INFO: Found listing with ID: 1873059
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873059%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Scrape type for 1873059: 2
2026-01-28 20:22:22 [ayvens.be] INFO: Extracting data for car ID: 1873059
2026-01-28 20:22:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a52a8e3a-5206-55ee-82bf-893948bc4039 with identifier: 1873059
2026-01-28 20:22:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a52a8e3a-5206-55ee-82bf-893948bc4039 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a52a8e3a-5206-55ee-82bf-893948bc4039 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a52a8e3a-5206-55ee-82bf-893948bc4039, identifier: 1873059
2026-01-28 20:22:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a52a8e3a-5206-55ee-82bf-893948bc4039 with identifier: 1873059
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a52a8e3a-5206-55ee-82bf-893948bc4039 with identifier: 1873059
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 140482 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    140482
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a52a8e3a-5206-55ee-82bf-893948bc4039 spider: ayvens.be
2026-01-28 20:22:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: a52a8e3a-5206-55ee-82bf-893948bc4039 due to rule: high_mileage_for_country.json, error: 140482 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    140482
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a52a8e3a-5206-55ee-82bf-893948bc4039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 140482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 90KW LIFE BUSINESS',
 'transmission': 'manual',
 'trim': '2.0 TDI 90KW LIFE BUSINESS',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873059%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Saving data for 1873059: {'auction_closing_time': 1769761800.0, 'created_time': 1769458005.369976, 'last_price_update_time': 1769631742.824883}
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873059') HTTP/1.1" 204 0
2026-01-28 20:22:22 [ayvens.be] INFO: Found listing with ID: 1873060
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873060%27 HTTP/1.1" 200 None
2026-01-28 20:22:22 [ayvens.be] INFO: Scrape type for 1873060: 2
2026-01-28 20:22:22 [ayvens.be] INFO: Extracting data for car ID: 1873060
2026-01-28 20:22:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 492f6c78-41e1-5ec2-8cc1-c20b45835131 with identifier: 1873060
2026-01-28 20:22:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 492f6c78-41e1-5ec2-8cc1-c20b45835131 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 492f6c78-41e1-5ec2-8cc1-c20b45835131 with scrape type 2
2026-01-28 20:22:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 492f6c78-41e1-5ec2-8cc1-c20b45835131, identifier: 1873060
2026-01-28 20:22:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 492f6c78-41e1-5ec2-8cc1-c20b45835131 with identifier: 1873060
2026-01-28 20:22:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 492f6c78-41e1-5ec2-8cc1-c20b45835131 with identifier: 1873060
2026-01-28 20:22:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 492f6c78-41e1-5ec2-8cc1-c20b45835131 with identifier: 1873060 to the API
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '492f6c78-41e1-5ec2-8cc1-c20b45835131',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 37896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873060%27 HTTP/1.1" 200 None
2026-01-28 20:22:23 [ayvens.be] INFO: Saving data for 1873060: {'auction_closing_time': 1769761800.0, 'created_time': 1769458317.703213, 'last_price_update_time': 1769631743.236681}
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873060') HTTP/1.1" 204 0
2026-01-28 20:22:23 [ayvens.be] INFO: Found listing with ID: 1873061
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873061%27 HTTP/1.1" 200 None
2026-01-28 20:22:23 [ayvens.be] INFO: Scrape type for 1873061: 2
2026-01-28 20:22:23 [ayvens.be] INFO: Extracting data for car ID: 1873061
2026-01-28 20:22:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b8f17e-fa57-5d22-8788-36a5d63e7967 with identifier: 1873061
2026-01-28 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b8f17e-fa57-5d22-8788-36a5d63e7967 with scrape type 2
2026-01-28 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b8f17e-fa57-5d22-8788-36a5d63e7967 with scrape type 2
2026-01-28 20:22:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 62b8f17e-fa57-5d22-8788-36a5d63e7967, identifier: 1873061
2026-01-28 20:22:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 62b8f17e-fa57-5d22-8788-36a5d63e7967 with identifier: 1873061
2026-01-28 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 62b8f17e-fa57-5d22-8788-36a5d63e7967 with identifier: 1873061
2026-01-28 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350m fou mwb hr dsl' containing 'transit'
2026-01-28 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 62b8f17e-fa57-5d22-8788-36a5d63e7967 spider: ayvens.be
2026-01-28 20:22:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 62b8f17e-fa57-5d22-8788-36a5d63e7967 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit 2t 350m fou mwb hr dsl' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '62b8f17e-fa57-5d22-8788-36a5d63e7967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'TRANSIT 2T 350M FOU MWB HR DSL',
 'odometer': 107964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'FORD TRANSIT 2T 350M FOU MWB HR DSL 2.0 TDCi L2H2 Trend',
 'transmission': 'manual',
 'trim': '2.0 TDCi L2H2 Trend',
 'vin': None,
 'year': 2018}
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873061%27 HTTP/1.1" 200 None
2026-01-28 20:22:23 [ayvens.be] INFO: Saving data for 1873061: {'auction_closing_time': 1769761800.0, 'created_time': 1769458310.884372, 'last_price_update_time': 1769631743.558057}
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873061') HTTP/1.1" 204 0
2026-01-28 20:22:23 [ayvens.be] INFO: Found listing with ID: 1873062
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873062%27 HTTP/1.1" 200 None
2026-01-28 20:22:23 [ayvens.be] INFO: Scrape type for 1873062: 2
2026-01-28 20:22:23 [ayvens.be] INFO: Extracting data for car ID: 1873062
2026-01-28 20:22:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3b25fea-a74e-54e2-a2e8-b99e6874a00f with identifier: 1873062
2026-01-28 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3b25fea-a74e-54e2-a2e8-b99e6874a00f with scrape type 2
2026-01-28 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3b25fea-a74e-54e2-a2e8-b99e6874a00f with scrape type 2
2026-01-28 20:22:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e3b25fea-a74e-54e2-a2e8-b99e6874a00f, identifier: 1873062
2026-01-28 20:22:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e3b25fea-a74e-54e2-a2e8-b99e6874a00f with identifier: 1873062
2026-01-28 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e3b25fea-a74e-54e2-a2e8-b99e6874a00f with identifier: 1873062
2026-01-28 20:22:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e3b25fea-a74e-54e2-a2e8-b99e6874a00f with identifier: 1873062 to the API
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'e3b25fea-a74e-54e2-a2e8-b99e6874a00f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'V60',
 'odometer': 101905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO V60 2.0 B3 MHEV MOMENTUM PRO DCT',
 'transmission': 'automatic',
 'trim': '2.0 B3 MHEV MOMENTUM PRO DCT',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873062%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Saving data for 1873062: {'auction_closing_time': 1769761800.0, 'created_time': 1769458309.896808, 'last_price_update_time': 1769631744.042795}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873062') HTTP/1.1" 204 0
2026-01-28 20:22:24 [ayvens.be] INFO: Found listing with ID: 1873063
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873063%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Scrape type for 1873063: 2
2026-01-28 20:22:24 [ayvens.be] INFO: Extracting data for car ID: 1873063
2026-01-28 20:22:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83042da-3916-554c-a7cd-2c6fcb2cde53 with identifier: 1873063
2026-01-28 20:22:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83042da-3916-554c-a7cd-2c6fcb2cde53 with scrape type 2
2026-01-28 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e83042da-3916-554c-a7cd-2c6fcb2cde53 with scrape type 2
2026-01-28 20:22:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e83042da-3916-554c-a7cd-2c6fcb2cde53, identifier: 1873063
2026-01-28 20:22:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e83042da-3916-554c-a7cd-2c6fcb2cde53 with identifier: 1873063
2026-01-28 20:22:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e83042da-3916-554c-a7cd-2c6fcb2cde53 with identifier: 1873063
2026-01-28 20:22:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e83042da-3916-554c-a7cd-2c6fcb2cde53 with identifier: 1873063 to the API
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e83042da-3916-554c-a7cd-2c6fcb2cde53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3',
 'odometer': 81020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'transmission': 'automatic',
 'trim': '2.0 35 TDI S TRONIC ADVANCED BUSINESS ED',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873063%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Saving data for 1873063: {'auction_closing_time': 1769761800.0, 'created_time': 1769458305.023567, 'last_price_update_time': 1769631744.455226}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873063') HTTP/1.1" 204 0
2026-01-28 20:22:24 [ayvens.be] INFO: Found listing with ID: 1873064
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873064%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Scrape type for 1873064: 2
2026-01-28 20:22:24 [ayvens.be] INFO: Extracting data for car ID: 1873064
2026-01-28 20:22:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9084a4-9348-5bb9-8286-d2810c3f58fa with identifier: 1873064
2026-01-28 20:22:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9084a4-9348-5bb9-8286-d2810c3f58fa with scrape type 2
2026-01-28 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df9084a4-9348-5bb9-8286-d2810c3f58fa with scrape type 2
2026-01-28 20:22:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df9084a4-9348-5bb9-8286-d2810c3f58fa, identifier: 1873064
2026-01-28 20:22:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df9084a4-9348-5bb9-8286-d2810c3f58fa with identifier: 1873064
2026-01-28 20:22:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df9084a4-9348-5bb9-8286-d2810c3f58fa with identifier: 1873064
2026-01-28 20:22:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df9084a4-9348-5bb9-8286-d2810c3f58fa with identifier: 1873064 to the API
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'df9084a4-9348-5bb9-8286-d2810c3f58fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 51387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873064%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Saving data for 1873064: {'auction_closing_time': 1769761800.0, 'created_time': 1769458299.745163, 'last_price_update_time': 1769631744.892044}
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873064') HTTP/1.1" 204 0
2026-01-28 20:22:24 [ayvens.be] INFO: Found listing with ID: 1873065
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873065%27 HTTP/1.1" 200 None
2026-01-28 20:22:24 [ayvens.be] INFO: Scrape type for 1873065: 2
2026-01-28 20:22:24 [ayvens.be] INFO: Extracting data for car ID: 1873065
2026-01-28 20:22:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b57be77-0989-5bf7-96e0-e026bf225af7 with identifier: 1873065
2026-01-28 20:22:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b57be77-0989-5bf7-96e0-e026bf225af7 with scrape type 2
2026-01-28 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b57be77-0989-5bf7-96e0-e026bf225af7 with scrape type 2
2026-01-28 20:22:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1b57be77-0989-5bf7-96e0-e026bf225af7, identifier: 1873065
2026-01-28 20:22:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1b57be77-0989-5bf7-96e0-e026bf225af7 with identifier: 1873065
2026-01-28 20:22:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1b57be77-0989-5bf7-96e0-e026bf225af7 with identifier: 1873065
2026-01-28 20:22:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1b57be77-0989-5bf7-96e0-e026bf225af7 with identifier: 1873065 to the API
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': '1b57be77-0989-5bf7-96e0-e026bf225af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 54836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 BEV 70KWH RECHARGE PLUS',
 'transmission': 'automatic',
 'trim': 'BEV 70KWH RECHARGE PLUS',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873065%27 HTTP/1.1" 200 None
2026-01-28 20:22:25 [ayvens.be] INFO: Saving data for 1873065: {'auction_closing_time': 1769761800.0, 'created_time': 1769458299.351555, 'last_price_update_time': 1769631745.31102}
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873065') HTTP/1.1" 204 0
2026-01-28 20:22:25 [ayvens.be] INFO: Found listing with ID: 1873066
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873066%27 HTTP/1.1" 200 None
2026-01-28 20:22:25 [ayvens.be] INFO: Scrape type for 1873066: 2
2026-01-28 20:22:25 [ayvens.be] INFO: Extracting data for car ID: 1873066
2026-01-28 20:22:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae94e5a6-ec40-5180-a722-e7bde464d3f0 with identifier: 1873066
2026-01-28 20:22:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae94e5a6-ec40-5180-a722-e7bde464d3f0 with scrape type 2
2026-01-28 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae94e5a6-ec40-5180-a722-e7bde464d3f0 with scrape type 2
2026-01-28 20:22:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ae94e5a6-ec40-5180-a722-e7bde464d3f0, identifier: 1873066
2026-01-28 20:22:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ae94e5a6-ec40-5180-a722-e7bde464d3f0 with identifier: 1873066
2026-01-28 20:22:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ae94e5a6-ec40-5180-a722-e7bde464d3f0 with identifier: 1873066
2026-01-28 20:22:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ae94e5a6-ec40-5180-a722-e7bde464d3f0 with identifier: 1873066 to the API
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ae94e5a6-ec40-5180-a722-e7bde464d3f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 - 2018',
 'odometer': 105026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 - 2018 50 TFSI e Quattro PHEV Sport S tronic',
 'transmission': 'automatic',
 'trim': '50 TFSI e Quattro PHEV Sport S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873066%27 HTTP/1.1" 200 None
2026-01-28 20:22:25 [ayvens.be] INFO: Saving data for 1873066: {'auction_closing_time': 1769761800.0, 'created_time': 1769458297.467291, 'last_price_update_time': 1769631745.736593}
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873066') HTTP/1.1" 204 0
2026-01-28 20:22:25 [ayvens.be] INFO: Found listing with ID: 1873067
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873067%27 HTTP/1.1" 200 None
2026-01-28 20:22:25 [ayvens.be] INFO: Scrape type for 1873067: 2
2026-01-28 20:22:25 [ayvens.be] INFO: Extracting data for car ID: 1873067
2026-01-28 20:22:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a7f20b-4024-54f8-84d3-5f050551d61d with identifier: 1873067
2026-01-28 20:22:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a7f20b-4024-54f8-84d3-5f050551d61d with scrape type 2
2026-01-28 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a7f20b-4024-54f8-84d3-5f050551d61d with scrape type 2
2026-01-28 20:22:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 65a7f20b-4024-54f8-84d3-5f050551d61d, identifier: 1873067
2026-01-28 20:22:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 65a7f20b-4024-54f8-84d3-5f050551d61d with identifier: 1873067
2026-01-28 20:22:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 65a7f20b-4024-54f8-84d3-5f050551d61d with identifier: 1873067
2026-01-28 20:22:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 65a7f20b-4024-54f8-84d3-5f050551d61d with identifier: 1873067 to the API
2026-01-28 20:22:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '65a7f20b-4024-54f8-84d3-5f050551d61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'KADJAR',
 'odometer': 66044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT KADJAR 1.3 TCE 140 DCT TECHNO',
 'transmission': 'automatic',
 'trim': '1.3 TCE 140 DCT TECHNO',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873067%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Saving data for 1873067: {'auction_closing_time': 1769761800.0, 'created_time': 1769458294.784169, 'last_price_update_time': 1769631746.144049}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873067') HTTP/1.1" 204 0
2026-01-28 20:22:26 [ayvens.be] INFO: Found listing with ID: 1873068
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873068%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Scrape type for 1873068: 2
2026-01-28 20:22:26 [ayvens.be] INFO: Extracting data for car ID: 1873068
2026-01-28 20:22:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with identifier: 1873068
2026-01-28 20:22:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with scrape type 2
2026-01-28 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with scrape type 2
2026-01-28 20:22:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 15bd7cce-fcf1-5e50-b5da-a3e5171c7996, identifier: 1873068
2026-01-28 20:22:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with identifier: 1873068
2026-01-28 20:22:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with identifier: 1873068
2026-01-28 20:22:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 15bd7cce-fcf1-5e50-b5da-a3e5171c7996 with identifier: 1873068 to the API
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '15bd7cce-fcf1-5e50-b5da-a3e5171c7996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008 DIESEL - 2020',
 'odometer': 89329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 DIESEL - 2020 1.5 BlueHDi GT Line',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi GT Line',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873068%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Saving data for 1873068: {'auction_closing_time': 1769761800.0, 'created_time': 1769458062.648644, 'last_price_update_time': 1769631746.538158}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873068') HTTP/1.1" 204 0
2026-01-28 20:22:26 [ayvens.be] INFO: Found listing with ID: 1873069
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873069%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Scrape type for 1873069: 2
2026-01-28 20:22:26 [ayvens.be] INFO: Extracting data for car ID: 1873069
2026-01-28 20:22:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49622a66-5219-50f4-9f83-86de00c8bcd4 with identifier: 1873069
2026-01-28 20:22:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49622a66-5219-50f4-9f83-86de00c8bcd4 with scrape type 2
2026-01-28 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49622a66-5219-50f4-9f83-86de00c8bcd4 with scrape type 2
2026-01-28 20:22:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 49622a66-5219-50f4-9f83-86de00c8bcd4, identifier: 1873069
2026-01-28 20:22:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 49622a66-5219-50f4-9f83-86de00c8bcd4 with identifier: 1873069
2026-01-28 20:22:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 49622a66-5219-50f4-9f83-86de00c8bcd4 with identifier: 1873069
2026-01-28 20:22:26 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 49622a66-5219-50f4-9f83-86de00c8bcd4 with identifier: 1873069 to the API
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '49622a66-5219-50f4-9f83-86de00c8bcd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 74923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873069%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Saving data for 1873069: {'auction_closing_time': 1769761800.0, 'created_time': 1769458068.976865, 'last_price_update_time': 1769631746.925524}
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873069') HTTP/1.1" 204 0
2026-01-28 20:22:26 [ayvens.be] INFO: Found listing with ID: 1873070
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873070%27 HTTP/1.1" 200 None
2026-01-28 20:22:26 [ayvens.be] INFO: Scrape type for 1873070: 2
2026-01-28 20:22:26 [ayvens.be] INFO: Extracting data for car ID: 1873070
2026-01-28 20:22:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f125b021-f45b-5d60-8b66-eb0aee5caaf3 with identifier: 1873070
2026-01-28 20:22:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f125b021-f45b-5d60-8b66-eb0aee5caaf3 with scrape type 2
2026-01-28 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f125b021-f45b-5d60-8b66-eb0aee5caaf3 with scrape type 2
2026-01-28 20:22:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f125b021-f45b-5d60-8b66-eb0aee5caaf3, identifier: 1873070
2026-01-28 20:22:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f125b021-f45b-5d60-8b66-eb0aee5caaf3 with identifier: 1873070
2026-01-28 20:22:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f125b021-f45b-5d60-8b66-eb0aee5caaf3 with identifier: 1873070
2026-01-28 20:22:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f125b021-f45b-5d60-8b66-eb0aee5caaf3 with identifier: 1873070 to the API
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f125b021-f45b-5d60-8b66-eb0aee5caaf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 120372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E DCT BUSINESS SOLUTION',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E DCT BUSINESS SOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873070%27 HTTP/1.1" 200 None
2026-01-28 20:22:27 [ayvens.be] INFO: Saving data for 1873070: {'auction_closing_time': 1769761800.0, 'created_time': 1769458292.08161, 'last_price_update_time': 1769631747.31689}
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873070') HTTP/1.1" 204 0
2026-01-28 20:22:27 [ayvens.be] INFO: Found listing with ID: 1873071
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873071%27 HTTP/1.1" 200 None
2026-01-28 20:22:27 [ayvens.be] INFO: Scrape type for 1873071: 2
2026-01-28 20:22:27 [ayvens.be] INFO: Extracting data for car ID: 1873071
2026-01-28 20:22:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b08cdd8-6ab6-58d5-aead-3594e82877be with identifier: 1873071
2026-01-28 20:22:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b08cdd8-6ab6-58d5-aead-3594e82877be with scrape type 2
2026-01-28 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b08cdd8-6ab6-58d5-aead-3594e82877be with scrape type 2
2026-01-28 20:22:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2b08cdd8-6ab6-58d5-aead-3594e82877be, identifier: 1873071
2026-01-28 20:22:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2b08cdd8-6ab6-58d5-aead-3594e82877be with identifier: 1873071
2026-01-28 20:22:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2b08cdd8-6ab6-58d5-aead-3594e82877be with identifier: 1873071
2026-01-28 20:22:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2b08cdd8-6ab6-58d5-aead-3594e82877be with identifier: 1873071 to the API
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '2b08cdd8-6ab6-58d5-aead-3594e82877be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'CLA',
 'odometer': 75116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ CLA 1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 CLA 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873071%27 HTTP/1.1" 200 None
2026-01-28 20:22:27 [ayvens.be] INFO: Saving data for 1873071: {'auction_closing_time': 1769761800.0, 'created_time': 1769458081.356603, 'last_price_update_time': 1769631747.733201}
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873071') HTTP/1.1" 204 0
2026-01-28 20:22:27 [ayvens.be] INFO: Found listing with ID: 1873072
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873072%27 HTTP/1.1" 200 None
2026-01-28 20:22:27 [ayvens.be] INFO: Scrape type for 1873072: 2
2026-01-28 20:22:27 [ayvens.be] INFO: Extracting data for car ID: 1873072
2026-01-28 20:22:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with identifier: 1873072
2026-01-28 20:22:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with scrape type 2
2026-01-28 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with scrape type 2
2026-01-28 20:22:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1e06ebd9-fd1d-508e-99b1-e45e5d07867b, identifier: 1873072
2026-01-28 20:22:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with identifier: 1873072
2026-01-28 20:22:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with identifier: 1873072
2026-01-28 20:22:27 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1e06ebd9-fd1d-508e-99b1-e45e5d07867b with identifier: 1873072 to the API
2026-01-28 20:22:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1e06ebd9-fd1d-508e-99b1-e45e5d07867b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 110404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T5 TE PHEV R-Design DCT STOCK',
 'transmission': 'automatic',
 'trim': '1.5 T5 TE PHEV R-Design DCT STOCK',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873072%27 HTTP/1.1" 200 None
2026-01-28 20:22:28 [ayvens.be] INFO: Saving data for 1873072: {'auction_closing_time': 1769761800.0, 'created_time': 1769458085.490991, 'last_price_update_time': 1769631748.119356}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873072') HTTP/1.1" 204 0
2026-01-28 20:22:28 [ayvens.be] INFO: Found listing with ID: 1873073
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873073%27 HTTP/1.1" 200 None
2026-01-28 20:22:28 [ayvens.be] INFO: Scrape type for 1873073: 2
2026-01-28 20:22:28 [ayvens.be] INFO: Extracting data for car ID: 1873073
2026-01-28 20:22:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2625db41-7fde-5470-8121-d7620706205c with identifier: 1873073
2026-01-28 20:22:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2625db41-7fde-5470-8121-d7620706205c with scrape type 2
2026-01-28 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2625db41-7fde-5470-8121-d7620706205c with scrape type 2
2026-01-28 20:22:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 2625db41-7fde-5470-8121-d7620706205c, identifier: 1873073
2026-01-28 20:22:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 2625db41-7fde-5470-8121-d7620706205c with identifier: 1873073
2026-01-28 20:22:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 2625db41-7fde-5470-8121-d7620706205c with identifier: 1873073
2026-01-28 20:22:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 2625db41-7fde-5470-8121-d7620706205c with identifier: 1873073 to the API
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '2625db41-7fde-5470-8121-d7620706205c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL - 2020',
 'odometer': 102721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA OCTAVIA DIESEL - 2020 2.0 CR TDi EVO Ambition DSG',
 'transmission': 'automatic',
 'trim': '2.0 CR TDi EVO Ambition DSG',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873073%27 HTTP/1.1" 200 None
2026-01-28 20:22:28 [ayvens.be] INFO: Saving data for 1873073: {'auction_closing_time': 1769761800.0, 'created_time': 1769458292.465455, 'last_price_update_time': 1769631748.588192}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873073') HTTP/1.1" 204 0
2026-01-28 20:22:28 [ayvens.be] INFO: Found listing with ID: 1873074
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873074%27 HTTP/1.1" 200 None
2026-01-28 20:22:28 [ayvens.be] INFO: Scrape type for 1873074: 2
2026-01-28 20:22:28 [ayvens.be] INFO: Extracting data for car ID: 1873074
2026-01-28 20:22:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with identifier: 1873074
2026-01-28 20:22:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with scrape type 2
2026-01-28 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with scrape type 2
2026-01-28 20:22:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 86db8c33-ee9b-570c-87af-3fdaf82dbbc5, identifier: 1873074
2026-01-28 20:22:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with identifier: 1873074
2026-01-28 20:22:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with identifier: 1873074
2026-01-28 20:22:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 86db8c33-ee9b-570c-87af-3fdaf82dbbc5 with identifier: 1873074 to the API
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '86db8c33-ee9b-570c-87af-3fdaf82dbbc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'SUZUKI',
 'model': 'SWIFT',
 'odometer': 52152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SUZUKI SWIFT 1.2 GRAND LUXE +',
 'transmission': 'manual',
 'trim': '1.2 GRAND LUXE +',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873074%27 HTTP/1.1" 200 None
2026-01-28 20:22:28 [ayvens.be] INFO: Saving data for 1873074: {'auction_closing_time': 1769761800.0, 'created_time': 1769458287.058795, 'last_price_update_time': 1769631748.972685}
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873074') HTTP/1.1" 204 0
2026-01-28 20:22:28 [ayvens.be] INFO: Found listing with ID: 1873075
2026-01-28 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873075%27 HTTP/1.1" 200 None
2026-01-28 20:22:29 [ayvens.be] INFO: Scrape type for 1873075: 2
2026-01-28 20:22:29 [ayvens.be] INFO: Extracting data for car ID: 1873075
2026-01-28 20:22:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3de80a7-9309-590a-a881-59feb733457e with identifier: 1873075
2026-01-28 20:22:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3de80a7-9309-590a-a881-59feb733457e with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3de80a7-9309-590a-a881-59feb733457e with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c3de80a7-9309-590a-a881-59feb733457e, identifier: 1873075
2026-01-28 20:22:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c3de80a7-9309-590a-a881-59feb733457e with identifier: 1873075
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c3de80a7-9309-590a-a881-59feb733457e with identifier: 1873075
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159481 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159481
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c3de80a7-9309-590a-a881-59feb733457e spider: ayvens.be
2026-01-28 20:22:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c3de80a7-9309-590a-a881-59feb733457e due to rule: high_mileage_for_country.json, error: 159481 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159481
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'c3de80a7-9309-590a-a881-59feb733457e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 DIESEL - 2018',
 'odometer': 159481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 DIESEL - 2018 2.0 dA xDrive20 MHD AdBlue',
 'transmission': 'automatic',
 'trim': '2.0 dA xDrive20 MHD AdBlue',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873075%27 HTTP/1.1" 200 None
2026-01-28 20:22:29 [ayvens.be] INFO: Saving data for 1873075: {'auction_closing_time': 1769761800.0, 'created_time': 1769458284.650281, 'last_price_update_time': 1769631749.318279}
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873075') HTTP/1.1" 204 0
2026-01-28 20:22:29 [ayvens.be] INFO: Found listing with ID: 1873076
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873076%27 HTTP/1.1" 200 None
2026-01-28 20:22:29 [ayvens.be] INFO: Scrape type for 1873076: 2
2026-01-28 20:22:29 [ayvens.be] INFO: Extracting data for car ID: 1873076
2026-01-28 20:22:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45ff80d5-b90f-5f75-a9af-8d8646d874fc with identifier: 1873076
2026-01-28 20:22:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45ff80d5-b90f-5f75-a9af-8d8646d874fc with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45ff80d5-b90f-5f75-a9af-8d8646d874fc with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45ff80d5-b90f-5f75-a9af-8d8646d874fc, identifier: 1873076
2026-01-28 20:22:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45ff80d5-b90f-5f75-a9af-8d8646d874fc with identifier: 1873076
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45ff80d5-b90f-5f75-a9af-8d8646d874fc with identifier: 1873076
2026-01-28 20:22:29 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 45ff80d5-b90f-5f75-a9af-8d8646d874fc with identifier: 1873076 to the API
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '45ff80d5-b90f-5f75-a9af-8d8646d874fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q3 Sportback',
 'odometer': 102643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q3 Sportback 1.4 45 TFSI E S TRONIC S LINE',
 'transmission': 'automatic',
 'trim': '1.4 45 TFSI E S TRONIC S LINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873076%27 HTTP/1.1" 200 None
2026-01-28 20:22:29 [ayvens.be] INFO: Saving data for 1873076: {'auction_closing_time': 1769761800.0, 'created_time': 1769458283.205848, 'last_price_update_time': 1769631749.753782}
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873076') HTTP/1.1" 204 0
2026-01-28 20:22:29 [ayvens.be] INFO: Found listing with ID: 1873077
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873077%27 HTTP/1.1" 200 None
2026-01-28 20:22:29 [ayvens.be] INFO: Scrape type for 1873077: 2
2026-01-28 20:22:29 [ayvens.be] INFO: Extracting data for car ID: 1873077
2026-01-28 20:22:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a56074-feef-57a1-8d5b-e43a7a752bb3 with identifier: 1873077
2026-01-28 20:22:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a56074-feef-57a1-8d5b-e43a7a752bb3 with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a56074-feef-57a1-8d5b-e43a7a752bb3 with scrape type 2
2026-01-28 20:22:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 45a56074-feef-57a1-8d5b-e43a7a752bb3, identifier: 1873077
2026-01-28 20:22:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 45a56074-feef-57a1-8d5b-e43a7a752bb3 with identifier: 1873077
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 45a56074-feef-57a1-8d5b-e43a7a752bb3 with identifier: 1873077
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159876 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159876
2026-01-28 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 45a56074-feef-57a1-8d5b-e43a7a752bb3 spider: ayvens.be
2026-01-28 20:22:30 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 45a56074-feef-57a1-8d5b-e43a7a752bb3 due to rule: high_mileage_for_country.json, error: 159876 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159876
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '45a56074-feef-57a1-8d5b-e43a7a752bb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 159876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 SDRIVE16D',
 'transmission': 'manual',
 'trim': '1.5 SDRIVE16D',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873077%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Saving data for 1873077: {'auction_closing_time': 1769761800.0, 'created_time': 1769458278.033427, 'last_price_update_time': 1769631750.07335}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873077') HTTP/1.1" 204 0
2026-01-28 20:22:30 [ayvens.be] INFO: Found listing with ID: 1873078
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873078%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Scrape type for 1873078: 2
2026-01-28 20:22:30 [ayvens.be] INFO: Extracting data for car ID: 1873078
2026-01-28 20:22:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8befc-3d91-5374-8853-ddc32b35feee with identifier: 1873078
2026-01-28 20:22:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8befc-3d91-5374-8853-ddc32b35feee with scrape type 2
2026-01-28 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a8befc-3d91-5374-8853-ddc32b35feee with scrape type 2
2026-01-28 20:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a1a8befc-3d91-5374-8853-ddc32b35feee, identifier: 1873078
2026-01-28 20:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a1a8befc-3d91-5374-8853-ddc32b35feee with identifier: 1873078
2026-01-28 20:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a1a8befc-3d91-5374-8853-ddc32b35feee with identifier: 1873078
2026-01-28 20:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a1a8befc-3d91-5374-8853-ddc32b35feee with identifier: 1873078 to the API
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a1a8befc-3d91-5374-8853-ddc32b35feee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 67107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116DA (85KW)',
 'transmission': 'automatic',
 'trim': '1.5 116DA (85KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873078%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Saving data for 1873078: {'auction_closing_time': 1769761800.0, 'created_time': 1769458276.928473, 'last_price_update_time': 1769631750.483365}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873078') HTTP/1.1" 204 0
2026-01-28 20:22:30 [ayvens.be] INFO: Found listing with ID: 1873079
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873079%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Scrape type for 1873079: 2
2026-01-28 20:22:30 [ayvens.be] INFO: Extracting data for car ID: 1873079
2026-01-28 20:22:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c307a802-cb10-50a5-8932-8208223a0067 with identifier: 1873079
2026-01-28 20:22:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c307a802-cb10-50a5-8932-8208223a0067 with scrape type 2
2026-01-28 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c307a802-cb10-50a5-8932-8208223a0067 with scrape type 2
2026-01-28 20:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c307a802-cb10-50a5-8932-8208223a0067, identifier: 1873079
2026-01-28 20:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c307a802-cb10-50a5-8932-8208223a0067 with identifier: 1873079
2026-01-28 20:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c307a802-cb10-50a5-8932-8208223a0067 with identifier: 1873079
2026-01-28 20:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: c307a802-cb10-50a5-8932-8208223a0067 with identifier: 1873079 to the API
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'c307a802-cb10-50a5-8932-8208223a0067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS',
 'odometer': 75799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS 1.3 A 250 E LUXURY LINE DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E LUXURY LINE DCT',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873079%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Saving data for 1873079: {'auction_closing_time': 1769761800.0, 'created_time': 1769458269.23219, 'last_price_update_time': 1769631750.875452}
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873079') HTTP/1.1" 204 0
2026-01-28 20:22:30 [ayvens.be] INFO: Found listing with ID: 1873080
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873080%27 HTTP/1.1" 200 None
2026-01-28 20:22:30 [ayvens.be] INFO: Scrape type for 1873080: 2
2026-01-28 20:22:30 [ayvens.be] INFO: Extracting data for car ID: 1873080
2026-01-28 20:22:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a with identifier: 1873080
2026-01-28 20:22:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a with scrape type 2
2026-01-28 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a with scrape type 2
2026-01-28 20:22:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a, identifier: 1873080
2026-01-28 20:22:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a with identifier: 1873080
2026-01-28 20:22:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a with identifier: 1873080
2026-01-28 20:22:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a6', 'trim': '2.0 tdi 30 s tronic business edition', 'title': 'audi a6 2.0 tdi 30 s tronic business edition', 'price': 0, 'odometer': 208991, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-24', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'audi a6', 'sanitized_make': 'audi', 'odometer_in_km': 208991}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'diesel',
     'id': '5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a6',
     'model': 'a6',
     'odometer': 208991,
     'odometer_in_km': 208991,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-24',
     'sanitized_make': 'audi',
     'seats_number': 5,
     'seller_name': None,
     'title': 'audi a6 2.0 tdi 30 s tronic business edition',
     'transmission': 'automatic',
     'trim': '2.0 tdi 30 s tronic business edition',
     'vin': None,
     'year': 2020}
2026-01-28 20:22:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a spider: ayvens.be
2026-01-28 20:22:31 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'audi', 'model': 'a6', 'trim': '2.0 tdi 30 s tronic business edition', 'title': 'audi a6 2.0 tdi 30 s tronic business edition', 'price': 0, 'odometer': 208991, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-24', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a', 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'audi a6', 'sanitized_make': 'audi', 'odometer_in_km': 208991}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 64,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'diesel',
     'id': '5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'audi',
     'make_model': 'audi a6',
     'model': 'a6',
     'odometer': 208991,
     'odometer_in_km': 208991,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-09-24',
     'sanitized_make': 'audi',
     'seats_number': 5,
     'seller_name': None,
     'title': 'audi a6 2.0 tdi 30 s tronic business edition',
     'transmission': 'automatic',
     'trim': '2.0 tdi 30 s tronic business edition',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '5c7c8eef-f3bd-5b06-8b42-f113a3e4e92a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6',
 'odometer': 208991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 2.0 TDI 30 S TRONIC BUSINESS EDITION',
 'transmission': 'automatic',
 'trim': '2.0 TDI 30 S TRONIC BUSINESS EDITION',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873080%27 HTTP/1.1" 200 None
2026-01-28 20:22:31 [ayvens.be] INFO: Saving data for 1873080: {'auction_closing_time': 1769761800.0, 'created_time': 1769458268.16173, 'last_price_update_time': 1769631751.563746}
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873080') HTTP/1.1" 204 0
2026-01-28 20:22:31 [ayvens.be] INFO: Found listing with ID: 1873081
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873081%27 HTTP/1.1" 200 None
2026-01-28 20:22:31 [ayvens.be] INFO: Scrape type for 1873081: 2
2026-01-28 20:22:31 [ayvens.be] INFO: Extracting data for car ID: 1873081
2026-01-28 20:22:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db4c953-6edc-5c02-acb0-919b85807569 with identifier: 1873081
2026-01-28 20:22:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db4c953-6edc-5c02-acb0-919b85807569 with scrape type 2
2026-01-28 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db4c953-6edc-5c02-acb0-919b85807569 with scrape type 2
2026-01-28 20:22:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 4db4c953-6edc-5c02-acb0-919b85807569, identifier: 1873081
2026-01-28 20:22:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 4db4c953-6edc-5c02-acb0-919b85807569 with identifier: 1873081
2026-01-28 20:22:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 4db4c953-6edc-5c02-acb0-919b85807569 with identifier: 1873081
2026-01-28 20:22:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 4db4c953-6edc-5c02-acb0-919b85807569 with identifier: 1873081 to the API
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '4db4c953-6edc-5c02-acb0-919b85807569',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 64250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CLIO 1.0 TCE 90 EVOLUTION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 EVOLUTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873081%27 HTTP/1.1" 200 None
2026-01-28 20:22:31 [ayvens.be] INFO: Saving data for 1873081: {'auction_closing_time': 1769761800.0, 'created_time': 1769458256.103429, 'last_price_update_time': 1769631751.980508}
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873081') HTTP/1.1" 204 0
2026-01-28 20:22:31 [ayvens.be] INFO: Found listing with ID: 1873082
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873082%27 HTTP/1.1" 200 None
2026-01-28 20:22:32 [ayvens.be] INFO: Scrape type for 1873082: 2
2026-01-28 20:22:32 [ayvens.be] INFO: Extracting data for car ID: 1873082
2026-01-28 20:22:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 with identifier: 1873082
2026-01-28 20:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 with scrape type 2
2026-01-28 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 with scrape type 2
2026-01-28 20:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027, identifier: 1873082
2026-01-28 20:22:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 with identifier: 1873082
2026-01-28 20:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 with identifier: 1873082
2026-01-28 20:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 125276 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125276
2026-01-28 20:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 spider: ayvens.be
2026-01-28 20:22:32 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027 due to rule: high_mileage_for_country.json, error: 125276 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    125276
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'dc4021d9-9f0c-5e3b-a9f8-4ca557e7f027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q5 DIESEL - 2017',
 'odometer': 125276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q5 DIESEL - 2017 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873082%27 HTTP/1.1" 200 None
2026-01-28 20:22:32 [ayvens.be] INFO: Saving data for 1873082: {'auction_closing_time': 1769761800.0, 'created_time': 1769458254.317522, 'last_price_update_time': 1769631752.311685}
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873082') HTTP/1.1" 204 0
2026-01-28 20:22:32 [ayvens.be] INFO: Found listing with ID: 1873083
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873083%27 HTTP/1.1" 200 None
2026-01-28 20:22:32 [ayvens.be] INFO: Scrape type for 1873083: 2
2026-01-28 20:22:32 [ayvens.be] INFO: Extracting data for car ID: 1873083
2026-01-28 20:22:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17326141-b86e-5c21-8ac3-2ecbb57938f0 with identifier: 1873083
2026-01-28 20:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17326141-b86e-5c21-8ac3-2ecbb57938f0 with scrape type 2
2026-01-28 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17326141-b86e-5c21-8ac3-2ecbb57938f0 with scrape type 2
2026-01-28 20:22:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 17326141-b86e-5c21-8ac3-2ecbb57938f0, identifier: 1873083
2026-01-28 20:22:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 17326141-b86e-5c21-8ac3-2ecbb57938f0 with identifier: 1873083
2026-01-28 20:22:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 17326141-b86e-5c21-8ac3-2ecbb57938f0 with identifier: 1873083
2026-01-28 20:22:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 17326141-b86e-5c21-8ac3-2ecbb57938f0 with identifier: 1873083 to the API
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '17326141-b86e-5c21-8ac3-2ecbb57938f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT',
 'odometer': 43920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT 2.0 TFSI 50 E S-TRONIC 4WD ATTRACTION',
 'transmission': 'automatic',
 'trim': '2.0 TFSI 50 E S-TRONIC 4WD ATTRACTION',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873083%27 HTTP/1.1" 200 None
2026-01-28 20:22:32 [ayvens.be] INFO: Saving data for 1873083: {'auction_closing_time': 1769761800.0, 'created_time': 1769458251.218454, 'last_price_update_time': 1769631752.753293}
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873083') HTTP/1.1" 204 0
2026-01-28 20:22:32 [ayvens.be] INFO: Found listing with ID: 1873084
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873084%27 HTTP/1.1" 200 None
2026-01-28 20:22:32 [ayvens.be] INFO: Scrape type for 1873084: 2
2026-01-28 20:22:32 [ayvens.be] INFO: Extracting data for car ID: 1873084
2026-01-28 20:22:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with identifier: 1873084
2026-01-28 20:22:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with scrape type 2
2026-01-28 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with scrape type 2
2026-01-28 20:22:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1a211ce4-2db1-581c-9ffd-0f3912ecdc77, identifier: 1873084
2026-01-28 20:22:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with identifier: 1873084
2026-01-28 20:22:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with identifier: 1873084
2026-01-28 20:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1a211ce4-2db1-581c-9ffd-0f3912ecdc77 with identifier: 1873084 to the API
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '1a211ce4-2db1-581c-9ffd-0f3912ecdc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 63075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'RENAULT CAPTUR 1.0 TCE 90 CORPORATE EDITION',
 'transmission': 'manual',
 'trim': '1.0 TCE 90 CORPORATE EDITION',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873084%27 HTTP/1.1" 200 None
2026-01-28 20:22:33 [ayvens.be] INFO: Saving data for 1873084: {'auction_closing_time': 1769761800.0, 'created_time': 1769458246.479248, 'last_price_update_time': 1769631753.286749}
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873084') HTTP/1.1" 204 0
2026-01-28 20:22:33 [ayvens.be] INFO: Found listing with ID: 1873085
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873085%27 HTTP/1.1" 200 None
2026-01-28 20:22:33 [ayvens.be] INFO: Scrape type for 1873085: 2
2026-01-28 20:22:33 [ayvens.be] INFO: Extracting data for car ID: 1873085
2026-01-28 20:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with identifier: 1873085
2026-01-28 20:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with scrape type 2
2026-01-28 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with scrape type 2
2026-01-28 20:22:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 1be1f923-dbbd-5e7b-8c21-bbdc878d623a, identifier: 1873085
2026-01-28 20:22:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with identifier: 1873085
2026-01-28 20:22:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with identifier: 1873085
2026-01-28 20:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 1be1f923-dbbd-5e7b-8c21-bbdc878d623a with identifier: 1873085 to the API
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '1be1f923-dbbd-5e7b-8c21-bbdc878d623a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '208 DIESEL - 2019',
 'odometer': 99662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 208 DIESEL - 2019 1.5 BlueHDi Active',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Active',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873085%27 HTTP/1.1" 200 None
2026-01-28 20:22:33 [ayvens.be] INFO: Saving data for 1873085: {'auction_closing_time': 1769761800.0, 'created_time': 1769458243.275774, 'last_price_update_time': 1769631753.726761}
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873085') HTTP/1.1" 204 0
2026-01-28 20:22:33 [ayvens.be] INFO: Found listing with ID: 1873086
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873086%27 HTTP/1.1" 200 None
2026-01-28 20:22:33 [ayvens.be] INFO: Scrape type for 1873086: 2
2026-01-28 20:22:33 [ayvens.be] INFO: Extracting data for car ID: 1873086
2026-01-28 20:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with identifier: 1873086
2026-01-28 20:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with scrape type 2
2026-01-28 20:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with scrape type 2
2026-01-28 20:22:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 39a3fc4b-ff13-59e7-9b3e-472c980d1125, identifier: 1873086
2026-01-28 20:22:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with identifier: 1873086
2026-01-28 20:22:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with identifier: 1873086
2026-01-28 20:22:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 39a3fc4b-ff13-59e7-9b3e-472c980d1125 with identifier: 1873086 to the API
2026-01-28 20:22:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '39a3fc4b-ff13-59e7-9b3e-472c980d1125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 67701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'transmission': 'automatic',
 'trim': '1.3 MHEV 116KW N-CONNECTA XTRONIC',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873086%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Saving data for 1873086: {'auction_closing_time': 1769761800.0, 'created_time': 1769458245.157219, 'last_price_update_time': 1769631754.137333}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873086') HTTP/1.1" 204 0
2026-01-28 20:22:34 [ayvens.be] INFO: Found listing with ID: 1873087
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873087%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Scrape type for 1873087: 2
2026-01-28 20:22:34 [ayvens.be] INFO: Extracting data for car ID: 1873087
2026-01-28 20:22:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c05893-7f37-581d-9de1-a2fc9414bd9e with identifier: 1873087
2026-01-28 20:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c05893-7f37-581d-9de1-a2fc9414bd9e with scrape type 2
2026-01-28 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c05893-7f37-581d-9de1-a2fc9414bd9e with scrape type 2
2026-01-28 20:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: f3c05893-7f37-581d-9de1-a2fc9414bd9e, identifier: 1873087
2026-01-28 20:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: f3c05893-7f37-581d-9de1-a2fc9414bd9e with identifier: 1873087
2026-01-28 20:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: f3c05893-7f37-581d-9de1-a2fc9414bd9e with identifier: 1873087
2026-01-28 20:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: f3c05893-7f37-581d-9de1-a2fc9414bd9e with identifier: 1873087 to the API
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'f3c05893-7f37-581d-9de1-a2fc9414bd9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 51269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'transmission': 'automatic',
 'trim': '1.5 T4 PHEV INSCRIPTION EXPR. DCT',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873087%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Saving data for 1873087: {'auction_closing_time': 1769761800.0, 'created_time': 1769458240.20446, 'last_price_update_time': 1769631754.532654}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873087') HTTP/1.1" 204 0
2026-01-28 20:22:34 [ayvens.be] INFO: Found listing with ID: 1873088
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873088%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Scrape type for 1873088: 2
2026-01-28 20:22:34 [ayvens.be] INFO: Extracting data for car ID: 1873088
2026-01-28 20:22:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with identifier: 1873088
2026-01-28 20:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with scrape type 2
2026-01-28 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with scrape type 2
2026-01-28 20:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e6a41a17-2dc7-5950-9fab-98b60a3a53a7, identifier: 1873088
2026-01-28 20:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with identifier: 1873088
2026-01-28 20:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with identifier: 1873088
2026-01-28 20:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e6a41a17-2dc7-5950-9fab-98b60a3a53a7 with identifier: 1873088 to the API
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'e6a41a17-2dc7-5950-9fab-98b60a3a53a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308 SW',
 'odometer': 115443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 SW 1.5 BLUEHDI 96KW S-S AUTO ALLURE',
 'transmission': 'automatic',
 'trim': '1.5 BLUEHDI 96KW S-S AUTO ALLURE',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873088%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Saving data for 1873088: {'auction_closing_time': 1769761800.0, 'created_time': 1769458238.061841, 'last_price_update_time': 1769631754.936175}
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873088') HTTP/1.1" 204 0
2026-01-28 20:22:34 [ayvens.be] INFO: Found listing with ID: 1873089
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873089%27 HTTP/1.1" 200 None
2026-01-28 20:22:34 [ayvens.be] INFO: Scrape type for 1873089: 2
2026-01-28 20:22:34 [ayvens.be] INFO: Extracting data for car ID: 1873089
2026-01-28 20:22:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77efb688-32e7-577f-80ee-26b77db2e261 with identifier: 1873089
2026-01-28 20:22:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77efb688-32e7-577f-80ee-26b77db2e261 with scrape type 2
2026-01-28 20:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77efb688-32e7-577f-80ee-26b77db2e261 with scrape type 2
2026-01-28 20:22:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 77efb688-32e7-577f-80ee-26b77db2e261, identifier: 1873089
2026-01-28 20:22:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 77efb688-32e7-577f-80ee-26b77db2e261 with identifier: 1873089
2026-01-28 20:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 77efb688-32e7-577f-80ee-26b77db2e261 with identifier: 1873089
2026-01-28 20:22:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 77efb688-32e7-577f-80ee-26b77db2e261 with identifier: 1873089 to the API
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': '77efb688-32e7-577f-80ee-26b77db2e261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '1 SERIES HATCH',
 'odometer': 60655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES HATCH 1.5 116D (85KW)',
 'transmission': 'manual',
 'trim': '1.5 116D (85KW)',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873089%27 HTTP/1.1" 200 None
2026-01-28 20:22:35 [ayvens.be] INFO: Saving data for 1873089: {'auction_closing_time': 1769761800.0, 'created_time': 1769458232.343389, 'last_price_update_time': 1769631755.319685}
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873089') HTTP/1.1" 204 0
2026-01-28 20:22:35 [ayvens.be] INFO: Found listing with ID: 1873090
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873090%27 HTTP/1.1" 200 None
2026-01-28 20:22:35 [ayvens.be] INFO: Scrape type for 1873090: 2
2026-01-28 20:22:35 [ayvens.be] INFO: Extracting data for car ID: 1873090
2026-01-28 20:22:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 with identifier: 1873090
2026-01-28 20:22:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 with scrape type 2
2026-01-28 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 with scrape type 2
2026-01-28 20:22:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9, identifier: 1873090
2026-01-28 20:22:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 with identifier: 1873090
2026-01-28 20:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 with identifier: 1873090
2026-01-28 20:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '2', 'trim': 'bev 78kwh single motor auto long range', 'title': 'polestar 2 bev 78kwh single motor auto long range', 'price': 0, 'odometer': 101830, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-13', 'year': 2022, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '364b88c6-1b5a-506a-a8fc-b30b4b57aac9', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'polestar 2', 'sanitized_make': 'polestar', 'odometer_in_km': 101830}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'electric',
     'id': '364b88c6-1b5a-506a-a8fc-b30b4b57aac9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 2',
     'model': '2',
     'odometer': 101830,
     'odometer_in_km': 101830,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-13',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 2 bev 78kwh single motor auto long range',
     'transmission': 'automatic',
     'trim': 'bev 78kwh single motor auto long range',
     'vin': None,
     'year': 2022}
2026-01-28 20:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 spider: ayvens.be
2026-01-28 20:22:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 364b88c6-1b5a-506a-a8fc-b30b4b57aac9 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'polestar', 'model': '2', 'trim': 'bev 78kwh single motor auto long range', 'title': 'polestar 2 bev 78kwh single motor auto long range', 'price': 0, 'odometer': 101830, 'odometer_reading_unit': 'km', 'registration_date': '2022-01-13', 'year': 2022, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078', 'expiration_date': '2026-01-30t08:30:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '364b88c6-1b5a-506a-a8fc-b30b4b57aac9', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'polestar 2', 'sanitized_make': 'polestar', 'odometer_in_km': 101830}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '',
     'expiration_date': '2026-01-30t08:30:00z',
     'fuel_type': 'electric',
     'id': '364b88c6-1b5a-506a-a8fc-b30b4b57aac9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
     'listing': 'auction',
     'location': None,
     'make': 'polestar',
     'make_model': 'polestar 2',
     'model': '2',
     'odometer': 101830,
     'odometer_in_km': 101830,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-01-13',
     'sanitized_make': 'polestar',
     'seats_number': 5,
     'seller_name': None,
     'title': 'polestar 2 bev 78kwh single motor auto long range',
     'transmission': 'automatic',
     'trim': 'bev 78kwh single motor auto long range',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': '364b88c6-1b5a-506a-a8fc-b30b4b57aac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'POLESTAR',
 'model': '2',
 'odometer': 101830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'POLESTAR 2 BEV 78KWH SINGLE MOTOR AUTO LONG RANGE',
 'transmission': 'automatic',
 'trim': 'BEV 78KWH SINGLE MOTOR AUTO LONG RANGE',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873090%27 HTTP/1.1" 200 None
2026-01-28 20:22:35 [ayvens.be] INFO: Saving data for 1873090: {'auction_closing_time': 1769761800.0, 'created_time': 1769458230.97638, 'last_price_update_time': 1769631755.665354}
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873090') HTTP/1.1" 204 0
2026-01-28 20:22:35 [ayvens.be] INFO: Found listing with ID: 1873091
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873091%27 HTTP/1.1" 200 None
2026-01-28 20:22:35 [ayvens.be] INFO: Scrape type for 1873091: 2
2026-01-28 20:22:35 [ayvens.be] INFO: Extracting data for car ID: 1873091
2026-01-28 20:22:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47193608-3b4c-5fd4-bf5c-f9f2495901ca with identifier: 1873091
2026-01-28 20:22:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47193608-3b4c-5fd4-bf5c-f9f2495901ca with scrape type 2
2026-01-28 20:22:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47193608-3b4c-5fd4-bf5c-f9f2495901ca with scrape type 2
2026-01-28 20:22:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 47193608-3b4c-5fd4-bf5c-f9f2495901ca, identifier: 1873091
2026-01-28 20:22:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 47193608-3b4c-5fd4-bf5c-f9f2495901ca with identifier: 1873091
2026-01-28 20:22:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:22:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 47193608-3b4c-5fd4-bf5c-f9f2495901ca with identifier: 1873091
2026-01-28 20:22:35 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 47193608-3b4c-5fd4-bf5c-f9f2495901ca with identifier: 1873091 to the API
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 21,
 'color': 'DEEP BLACK PEARL',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '47193608-3b4c-5fd4-bf5c-f9f2495901ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'GOLF VIII',
 'odometer': 75925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF VIII 1.4 EHYBRID STYLE BUSINESS DSG',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID STYLE BUSINESS DSG',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873091%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Saving data for 1873091: {'auction_closing_time': 1769761800.0, 'created_time': 1769458223.854361, 'last_price_update_time': 1769631756.067531}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873091') HTTP/1.1" 204 0
2026-01-28 20:22:36 [ayvens.be] INFO: Found listing with ID: 1873092
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873092%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Scrape type for 1873092: 2
2026-01-28 20:22:36 [ayvens.be] INFO: Extracting data for car ID: 1873092
2026-01-28 20:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with identifier: 1873092
2026-01-28 20:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with scrape type 2
2026-01-28 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with scrape type 2
2026-01-28 20:22:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 81c6c47c-5dd2-5ae4-8eed-434e24f64951, identifier: 1873092
2026-01-28 20:22:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with identifier: 1873092
2026-01-28 20:22:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with identifier: 1873092
2026-01-28 20:22:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 81c6c47c-5dd2-5ae4-8eed-434e24f64951 with identifier: 1873092 to the API
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 53,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '81c6c47c-5dd2-5ae4-8eed-434e24f64951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X3 - 2018',
 'odometer': 113226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 - 2018 2.0iA xDrive30e PHEV OPF',
 'transmission': 'automatic',
 'trim': '2.0iA xDrive30e PHEV OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873092%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Saving data for 1873092: {'auction_closing_time': 1769761800.0, 'created_time': 1769458215.56231, 'last_price_update_time': 1769631756.464293}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873092') HTTP/1.1" 204 0
2026-01-28 20:22:36 [ayvens.be] INFO: Found listing with ID: 1873093
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873093%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Scrape type for 1873093: 2
2026-01-28 20:22:36 [ayvens.be] INFO: Extracting data for car ID: 1873093
2026-01-28 20:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de4ee3-1e65-5475-9595-dffd987bec8c with identifier: 1873093
2026-01-28 20:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de4ee3-1e65-5475-9595-dffd987bec8c with scrape type 2
2026-01-28 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de4ee3-1e65-5475-9595-dffd987bec8c with scrape type 2
2026-01-28 20:22:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 49de4ee3-1e65-5475-9595-dffd987bec8c, identifier: 1873093
2026-01-28 20:22:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 49de4ee3-1e65-5475-9595-dffd987bec8c with identifier: 1873093
2026-01-28 20:22:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 49de4ee3-1e65-5475-9595-dffd987bec8c with identifier: 1873093
2026-01-28 20:22:36 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 49de4ee3-1e65-5475-9595-dffd987bec8c with identifier: 1873093 to the API
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': '49de4ee3-1e65-5475-9595-dffd987bec8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC',
 'odometer': 54349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN T-ROC 1.0 TSI Style OPF',
 'transmission': 'manual',
 'trim': '1.0 TSI Style OPF',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873093%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Saving data for 1873093: {'auction_closing_time': 1769761800.0, 'created_time': 1769458198.928259, 'last_price_update_time': 1769631756.877131}
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873093') HTTP/1.1" 204 0
2026-01-28 20:22:36 [ayvens.be] INFO: Found listing with ID: 1873094
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873094%27 HTTP/1.1" 200 None
2026-01-28 20:22:36 [ayvens.be] INFO: Scrape type for 1873094: 2
2026-01-28 20:22:36 [ayvens.be] INFO: Extracting data for car ID: 1873094
2026-01-28 20:22:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5fe9fc-c310-5275-9a42-80b1307db232 with identifier: 1873094
2026-01-28 20:22:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5fe9fc-c310-5275-9a42-80b1307db232 with scrape type 2
2026-01-28 20:22:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5fe9fc-c310-5275-9a42-80b1307db232 with scrape type 2
2026-01-28 20:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ad5fe9fc-c310-5275-9a42-80b1307db232, identifier: 1873094
2026-01-28 20:22:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ad5fe9fc-c310-5275-9a42-80b1307db232 with identifier: 1873094
2026-01-28 20:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ad5fe9fc-c310-5275-9a42-80b1307db232 with identifier: 1873094
2026-01-28 20:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: ad5fe9fc-c310-5275-9a42-80b1307db232 with identifier: 1873094 to the API
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'electric',
 'id': 'ad5fe9fc-c310-5275-9a42-80b1307db232',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 74343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873094%27 HTTP/1.1" 200 None
2026-01-28 20:22:37 [ayvens.be] INFO: Saving data for 1873094: {'auction_closing_time': 1769761800.0, 'created_time': 1769458214.384602, 'last_price_update_time': 1769631757.292749}
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873094') HTTP/1.1" 204 0
2026-01-28 20:22:37 [ayvens.be] INFO: Found listing with ID: 1873095
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873095%27 HTTP/1.1" 200 None
2026-01-28 20:22:37 [ayvens.be] INFO: Scrape type for 1873095: 2
2026-01-28 20:22:37 [ayvens.be] INFO: Extracting data for car ID: 1873095
2026-01-28 20:22:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 with identifier: 1873095
2026-01-28 20:22:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 with scrape type 2
2026-01-28 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 with scrape type 2
2026-01-28 20:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9, identifier: 1873095
2026-01-28 20:22:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 with identifier: 1873095
2026-01-28 20:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 with identifier: 1873095
2026-01-28 20:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145255 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145255
2026-01-28 20:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 spider: ayvens.be
2026-01-28 20:22:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: ab2361f8-4ad0-571f-bfe5-4a21dc812ac9 due to rule: high_mileage_for_country.json, error: 145255 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    145255
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'ab2361f8-4ad0-571f-bfe5-4a21dc812ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 145255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'FORD FOCUS 1.0I ECOBOOST MHEV 92KW ST-LINE',
 'transmission': 'manual',
 'trim': '1.0I ECOBOOST MHEV 92KW ST-LINE',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873095%27 HTTP/1.1" 200 None
2026-01-28 20:22:37 [ayvens.be] INFO: Saving data for 1873095: {'auction_closing_time': 1769761800.0, 'created_time': 1769458211.861775, 'last_price_update_time': 1769631757.70585}
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873095') HTTP/1.1" 204 0
2026-01-28 20:22:37 [ayvens.be] INFO: Found listing with ID: 1873096
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873096%27 HTTP/1.1" 200 None
2026-01-28 20:22:37 [ayvens.be] INFO: Scrape type for 1873096: 2
2026-01-28 20:22:37 [ayvens.be] INFO: Extracting data for car ID: 1873096
2026-01-28 20:22:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a48eebe6-77e3-5c5e-976a-33579b2df18c with identifier: 1873096
2026-01-28 20:22:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a48eebe6-77e3-5c5e-976a-33579b2df18c with scrape type 2
2026-01-28 20:22:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a48eebe6-77e3-5c5e-976a-33579b2df18c with scrape type 2
2026-01-28 20:22:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: a48eebe6-77e3-5c5e-976a-33579b2df18c, identifier: 1873096
2026-01-28 20:22:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: a48eebe6-77e3-5c5e-976a-33579b2df18c with identifier: 1873096
2026-01-28 20:22:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: a48eebe6-77e3-5c5e-976a-33579b2df18c with identifier: 1873096
2026-01-28 20:22:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: a48eebe6-77e3-5c5e-976a-33579b2df18c with identifier: 1873096 to the API
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'diesel',
 'id': 'a48eebe6-77e3-5c5e-976a-33579b2df18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'VOLVO',
 'model': 'XC40 DIESEL',
 'odometer': 101912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLVO XC40 DIESEL 2.0 D3 Momentum Pro Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D3 Momentum Pro Geartronic',
 'vin': None,
 'year': 2019}
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873096%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Saving data for 1873096: {'auction_closing_time': 1769761800.0, 'created_time': 1769458222.297128, 'last_price_update_time': 1769631758.107939}
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873096') HTTP/1.1" 204 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1873097
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873097%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1873097: 2
2026-01-28 20:22:38 [ayvens.be] INFO: Extracting data for car ID: 1873097
2026-01-28 20:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9cf2f6a-df80-5818-bb5f-7435555f5b12 with identifier: 1873097
2026-01-28 20:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9cf2f6a-df80-5818-bb5f-7435555f5b12 with scrape type 2
2026-01-28 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9cf2f6a-df80-5818-bb5f-7435555f5b12 with scrape type 2
2026-01-28 20:22:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b9cf2f6a-df80-5818-bb5f-7435555f5b12, identifier: 1873097
2026-01-28 20:22:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b9cf2f6a-df80-5818-bb5f-7435555f5b12 with identifier: 1873097
2026-01-28 20:22:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b9cf2f6a-df80-5818-bb5f-7435555f5b12 with identifier: 1873097
2026-01-28 20:22:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b9cf2f6a-df80-5818-bb5f-7435555f5b12 with identifier: 1873097 to the API
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-30T08:30:00Z',
 'fuel_type': 'petrol',
 'id': 'b9cf2f6a-df80-5818-bb5f-7435555f5b12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39078',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '5008',
 'odometer': 77697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'PEUGEOT 5008 1.2 PURETECH 130 AUTO ALLURE PACK',
 'transmission': 'automatic',
 'trim': '1.2 PURETECH 130 AUTO ALLURE PACK',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271873097%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Saving data for 1873097: {'auction_closing_time': 1769761800.0, 'created_time': 1769458229.681894, 'last_price_update_time': 1769631758.49088}
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1873097') HTTP/1.1" 204 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1877111
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877111%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1877111: 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1877112
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877112%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1877112: 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1877113
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877113%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1877113: 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1877114
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877114%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1877114: 0
2026-01-28 20:22:38 [ayvens.be] INFO: Found listing with ID: 1877115
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877115%27 HTTP/1.1" 200 None
2026-01-28 20:22:38 [ayvens.be] INFO: Scrape type for 1877115: 2
2026-01-28 20:22:38 [ayvens.be] INFO: Extracting data for car ID: 1877115
2026-01-28 20:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df4ddadb-22a5-5802-af53-eddc5f27d665 with identifier: 1877115
2026-01-28 20:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4ddadb-22a5-5802-af53-eddc5f27d665 with scrape type 2
2026-01-28 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df4ddadb-22a5-5802-af53-eddc5f27d665 with scrape type 2
2026-01-28 20:22:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: df4ddadb-22a5-5802-af53-eddc5f27d665, identifier: 1877115
2026-01-28 20:22:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: df4ddadb-22a5-5802-af53-eddc5f27d665 with identifier: 1877115
2026-01-28 20:22:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: df4ddadb-22a5-5802-af53-eddc5f27d665 with identifier: 1877115
2026-01-28 20:22:38 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: df4ddadb-22a5-5802-af53-eddc5f27d665 with identifier: 1877115 to the API
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'df4ddadb-22a5-5802-af53-eddc5f27d665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'PEUGEOT',
 'model': '308',
 'odometer': 55234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'PEUGEOT 308 1.2 PURETECH 96KW S-S ALLURE PACK',
 'transmission': 'manual',
 'trim': '1.2 PURETECH 96KW S-S ALLURE PACK',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877115%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Saving data for 1877115: {'auction_closing_time': 1769691600.0, 'created_time': 1769545174.455686, 'last_price_update_time': 1769631759.018912}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877115') HTTP/1.1" 204 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877116
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877116%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877116: 2
2026-01-28 20:22:39 [ayvens.be] INFO: Extracting data for car ID: 1877116
2026-01-28 20:22:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e5afed4-f180-5818-90c4-079a352eba26 with identifier: 1877116
2026-01-28 20:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e5afed4-f180-5818-90c4-079a352eba26 with scrape type 2
2026-01-28 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e5afed4-f180-5818-90c4-079a352eba26 with scrape type 2
2026-01-28 20:22:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 8e5afed4-f180-5818-90c4-079a352eba26, identifier: 1877116
2026-01-28 20:22:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 8e5afed4-f180-5818-90c4-079a352eba26 with identifier: 1877116
2026-01-28 20:22:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 8e5afed4-f180-5818-90c4-079a352eba26 with identifier: 1877116
2026-01-28 20:22:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151030 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    151030
2026-01-28 20:22:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8e5afed4-f180-5818-90c4-079a352eba26 spider: ayvens.be
2026-01-28 20:22:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 8e5afed4-f180-5818-90c4-079a352eba26 due to rule: high_mileage_for_country.json, error: 151030 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    151030
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '8e5afed4-f180-5818-90c4-079a352eba26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON SHOOTING BRAKE',
 'odometer': 151030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON SHOOTING BRAKE 1.4 EHYBRID DSG R-LINE SHOOTING '
          'BRAKE',
 'transmission': 'automatic',
 'trim': '1.4 EHYBRID DSG R-LINE SHOOTING BRAKE',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877116%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Saving data for 1877116: {'auction_closing_time': 1769691600.0, 'created_time': 1769545183.025572, 'last_price_update_time': 1769631759.359857}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877116') HTTP/1.1" 204 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877117
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877117%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877117: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877118
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877118%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877118: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877119
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877119%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877119: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877120
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877120%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877120: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877121
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877121%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877121: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877122
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877122%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877122: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877123
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877123%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877123: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877124
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877124%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877124: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877125
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877125%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877125: 0
2026-01-28 20:22:39 [ayvens.be] INFO: Found listing with ID: 1877126
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877126%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Scrape type for 1877126: 2
2026-01-28 20:22:39 [ayvens.be] INFO: Extracting data for car ID: 1877126
2026-01-28 20:22:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with identifier: 1877126
2026-01-28 20:22:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with scrape type 2
2026-01-28 20:22:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with scrape type 2
2026-01-28 20:22:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: b7c2864f-72a5-5d4b-bba8-bdd85c8f7967, identifier: 1877126
2026-01-28 20:22:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with identifier: 1877126
2026-01-28 20:22:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with identifier: 1877126
2026-01-28 20:22:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: b7c2864f-72a5-5d4b-bba8-bdd85c8f7967 with identifier: 1877126 to the API
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': 'b7c2864f-72a5-5d4b-bba8-bdd85c8f7967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 88988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877126%27 HTTP/1.1" 200 None
2026-01-28 20:22:39 [ayvens.be] INFO: Saving data for 1877126: {'auction_closing_time': 1769691600.0, 'created_time': 1769545232.346473, 'last_price_update_time': 1769631759.89902}
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877126') HTTP/1.1" 204 0
2026-01-28 20:22:40 [ayvens.be] INFO: Found listing with ID: 1877127
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877127%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Scrape type for 1877127: 0
2026-01-28 20:22:40 [ayvens.be] INFO: Found listing with ID: 1877128
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877128%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Scrape type for 1877128: 0
2026-01-28 20:22:40 [ayvens.be] INFO: Found listing with ID: 1877129
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877129%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Scrape type for 1877129: 2
2026-01-28 20:22:40 [ayvens.be] INFO: Extracting data for car ID: 1877129
2026-01-28 20:22:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a3b5fe-4ad1-53f2-bf63-8e644205852d with identifier: 1877129
2026-01-28 20:22:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a3b5fe-4ad1-53f2-bf63-8e644205852d with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a3b5fe-4ad1-53f2-bf63-8e644205852d with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 82a3b5fe-4ad1-53f2-bf63-8e644205852d, identifier: 1877129
2026-01-28 20:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 82a3b5fe-4ad1-53f2-bf63-8e644205852d with identifier: 1877129
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 82a3b5fe-4ad1-53f2-bf63-8e644205852d with identifier: 1877129
2026-01-28 20:22:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 82a3b5fe-4ad1-53f2-bf63-8e644205852d with identifier: 1877129 to the API
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '82a3b5fe-4ad1-53f2-bf63-8e644205852d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 1.5 XDRIVE25E (162KW)',
 'transmission': 'automatic',
 'trim': '1.5 XDRIVE25E (162KW)',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877129%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Saving data for 1877129: {'auction_closing_time': 1769691600.0, 'created_time': 1769545258.419076, 'last_price_update_time': 1769631760.395812}
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877129') HTTP/1.1" 204 0
2026-01-28 20:22:40 [ayvens.be] INFO: Found listing with ID: 1877130
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877130%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Scrape type for 1877130: 2
2026-01-28 20:22:40 [ayvens.be] INFO: Extracting data for car ID: 1877130
2026-01-28 20:22:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 389efa28-0e91-5cc6-b9e8-2aff629515a6 with identifier: 1877130
2026-01-28 20:22:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 389efa28-0e91-5cc6-b9e8-2aff629515a6 with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 389efa28-0e91-5cc6-b9e8-2aff629515a6 with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 389efa28-0e91-5cc6-b9e8-2aff629515a6, identifier: 1877130
2026-01-28 20:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 389efa28-0e91-5cc6-b9e8-2aff629515a6 with identifier: 1877130
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 389efa28-0e91-5cc6-b9e8-2aff629515a6 with identifier: 1877130
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159114 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159114
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 389efa28-0e91-5cc6-b9e8-2aff629515a6 spider: ayvens.be
2026-01-28 20:22:40 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 389efa28-0e91-5cc6-b9e8-2aff629515a6 due to rule: high_mileage_for_country.json, error: 159114 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    159114
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.6L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '389efa28-0e91-5cc6-b9e8-2aff629515a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'DS AUTOMOBILES',
 'model': 'DS 9',
 'odometer': 159114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS AUTOMOBILES DS 9 1.6 PHEV 225 RIVOLI +',
 'transmission': 'automatic',
 'trim': '1.6 PHEV 225 RIVOLI +',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877130%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Saving data for 1877130: {'auction_closing_time': 1769691600.0, 'created_time': 1769545253.540062, 'last_price_update_time': 1769631760.70804}
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877130') HTTP/1.1" 204 0
2026-01-28 20:22:40 [ayvens.be] INFO: Found listing with ID: 1877131
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877131%27 HTTP/1.1" 200 None
2026-01-28 20:22:40 [ayvens.be] INFO: Scrape type for 1877131: 2
2026-01-28 20:22:40 [ayvens.be] INFO: Extracting data for car ID: 1877131
2026-01-28 20:22:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ae64475-4928-50e8-872a-210092e3699b with identifier: 1877131
2026-01-28 20:22:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ae64475-4928-50e8-872a-210092e3699b with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ae64475-4928-50e8-872a-210092e3699b with scrape type 2
2026-01-28 20:22:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0ae64475-4928-50e8-872a-210092e3699b, identifier: 1877131
2026-01-28 20:22:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0ae64475-4928-50e8-872a-210092e3699b with identifier: 1877131
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0ae64475-4928-50e8-872a-210092e3699b with identifier: 1877131
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143175 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143175
2026-01-28 20:22:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0ae64475-4928-50e8-872a-210092e3699b spider: ayvens.be
2026-01-28 20:22:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0ae64475-4928-50e8-872a-210092e3699b due to rule: high_mileage_for_country.json, error: 143175 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    143175
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0ae64475-4928-50e8-872a-210092e3699b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'A6 AVANT DIESEL - 2018',
 'odometer': 143175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI A6 AVANT DIESEL - 2018 35 TDi Business Edition S tronic',
 'transmission': 'automatic',
 'trim': '35 TDi Business Edition S tronic',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877131%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Saving data for 1877131: {'auction_closing_time': 1769691600.0, 'created_time': 1769545257.676955, 'last_price_update_time': 1769631761.046285}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877131') HTTP/1.1" 204 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877132
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877132%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877132: 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877133
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877133%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877133: 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877134
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877134%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877134: 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877135
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877135%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877135: 2
2026-01-28 20:22:41 [ayvens.be] INFO: Extracting data for car ID: 1877135
2026-01-28 20:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e10ec15-352c-5ab9-be0d-734fc28f724d with identifier: 1877135
2026-01-28 20:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e10ec15-352c-5ab9-be0d-734fc28f724d with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e10ec15-352c-5ab9-be0d-734fc28f724d with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9e10ec15-352c-5ab9-be0d-734fc28f724d, identifier: 1877135
2026-01-28 20:22:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9e10ec15-352c-5ab9-be0d-734fc28f724d with identifier: 1877135
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9e10ec15-352c-5ab9-be0d-734fc28f724d with identifier: 1877135
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156386 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    156386
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9e10ec15-352c-5ab9-be0d-734fc28f724d spider: ayvens.be
2026-01-28 20:22:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 9e10ec15-352c-5ab9-be0d-734fc28f724d due to rule: high_mileage_for_country.json, error: 156386 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    156386
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9e10ec15-352c-5ab9-be0d-734fc28f724d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 156386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 SERIES TOURING 2.0 320E TOURING',
 'transmission': 'automatic',
 'trim': '2.0 320E TOURING',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877135%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Saving data for 1877135: {'auction_closing_time': 1769691600.0, 'created_time': 1769545326.219954, 'last_price_update_time': 1769631761.469969}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877135') HTTP/1.1" 204 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877136
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877136%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877136: 2
2026-01-28 20:22:41 [ayvens.be] INFO: Extracting data for car ID: 1877136
2026-01-28 20:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 with identifier: 1877136
2026-01-28 20:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2, identifier: 1877136
2026-01-28 20:22:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 with identifier: 1877136
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 with identifier: 1877136
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152370 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152370
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 spider: ayvens.be
2026-01-28 20:22:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: c94fa65b-d62c-5dfb-9c1e-b6865f197cc2 due to rule: high_mileage_for_country.json, error: 152370 is greater than the maximum of 125000

Failed validating 'maximum' in schema['allOf'][3]['then']['properties']['odometer_in_km']:
    {'maximum': 125000, 'type': 'integer'}

On instance['odometer_in_km']:
    152370
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'diesel',
 'id': 'c94fa65b-d62c-5dfb-9c1e-b6865f197cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'VOLKSWAGEN',
 'model': 'ARTEON',
 'odometer': 152370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'VOLKSWAGEN ARTEON 2.0 TDI 110KW DSG SHOOTING BRAKE',
 'transmission': 'automatic',
 'trim': '2.0 TDI 110KW DSG SHOOTING BRAKE',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877136%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Saving data for 1877136: {'auction_closing_time': 1769691600.0, 'created_time': 1769545324.962538, 'last_price_update_time': 1769631761.787805}
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877136') HTTP/1.1" 204 0
2026-01-28 20:22:41 [ayvens.be] INFO: Found listing with ID: 1877137
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877137%27 HTTP/1.1" 200 None
2026-01-28 20:22:41 [ayvens.be] INFO: Scrape type for 1877137: 2
2026-01-28 20:22:41 [ayvens.be] INFO: Extracting data for car ID: 1877137
2026-01-28 20:22:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with identifier: 1877137
2026-01-28 20:22:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with scrape type 2
2026-01-28 20:22:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: e8ceaf8d-d7b6-58c0-aa49-759bb25340cd, identifier: 1877137
2026-01-28 20:22:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with identifier: 1877137
2026-01-28 20:22:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with identifier: 1877137
2026-01-28 20:22:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: e8ceaf8d-d7b6-58c0-aa49-759bb25340cd with identifier: 1877137 to the API
2026-01-28 20:22:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'e8ceaf8d-d7b6-58c0-aa49-759bb25340cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL Y',
 'odometer': 86464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL Y BEV 75KWH LONG RANGE AUTO 4WD',
 'transmission': 'automatic',
 'trim': 'BEV 75KWH LONG RANGE AUTO 4WD',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877137%27 HTTP/1.1" 200 None
2026-01-28 20:22:42 [ayvens.be] INFO: Saving data for 1877137: {'auction_closing_time': 1769691600.0, 'created_time': 1769545323.17745, 'last_price_update_time': 1769631762.168761}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877137') HTTP/1.1" 204 0
2026-01-28 20:22:42 [ayvens.be] INFO: Found listing with ID: 1877138
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877138%27 HTTP/1.1" 200 None
2026-01-28 20:22:42 [ayvens.be] INFO: Scrape type for 1877138: 2
2026-01-28 20:22:42 [ayvens.be] INFO: Extracting data for car ID: 1877138
2026-01-28 20:22:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with identifier: 1877138
2026-01-28 20:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with scrape type 2
2026-01-28 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with scrape type 2
2026-01-28 20:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 9236bb4a-5023-5cd1-a54c-e91fccb44eaf, identifier: 1877138
2026-01-28 20:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with identifier: 1877138
2026-01-28 20:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with identifier: 1877138
2026-01-28 20:22:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 9236bb4a-5023-5cd1-a54c-e91fccb44eaf with identifier: 1877138 to the API
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '9236bb4a-5023-5cd1-a54c-e91fccb44eaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'SEAT',
 'model': 'LEON ST',
 'odometer': 95898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT LEON ST 1.0 ETSI 110 MOVE! DSG',
 'transmission': 'automatic',
 'trim': '1.0 ETSI 110 MOVE! DSG',
 'vin': None,
 'year': 2024}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877138%27 HTTP/1.1" 200 None
2026-01-28 20:22:42 [ayvens.be] INFO: Saving data for 1877138: {'auction_closing_time': 1769691600.0, 'created_time': 1769545321.668889, 'last_price_update_time': 1769631762.649675}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877138') HTTP/1.1" 204 0
2026-01-28 20:22:42 [ayvens.be] INFO: Found listing with ID: 1877139
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877139%27 HTTP/1.1" 200 None
2026-01-28 20:22:42 [ayvens.be] INFO: Scrape type for 1877139: 2
2026-01-28 20:22:42 [ayvens.be] INFO: Extracting data for car ID: 1877139
2026-01-28 20:22:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f98b969-e4e6-5ecc-b120-67628ea779c4 with identifier: 1877139
2026-01-28 20:22:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f98b969-e4e6-5ecc-b120-67628ea779c4 with scrape type 2
2026-01-28 20:22:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f98b969-e4e6-5ecc-b120-67628ea779c4 with scrape type 2
2026-01-28 20:22:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 0f98b969-e4e6-5ecc-b120-67628ea779c4, identifier: 1877139
2026-01-28 20:22:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 0f98b969-e4e6-5ecc-b120-67628ea779c4 with identifier: 1877139
2026-01-28 20:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 0f98b969-e4e6-5ecc-b120-67628ea779c4 with identifier: 1877139
2026-01-28 20:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': '6gt', 'trim': '2.0 620d gran turismo 120kw auto', 'title': 'bmw 6gt 2.0 620d gran turismo 120kw auto', 'price': 0, 'odometer': 200064, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-01', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134', 'expiration_date': '2026-01-29t13:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '0f98b969-e4e6-5ecc-b120-67628ea779c4', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'bmw 6gt', 'sanitized_make': 'bmw', 'odometer_in_km': 200064}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t13:00:00z',
     'fuel_type': 'diesel',
     'id': '0f98b969-e4e6-5ecc-b120-67628ea779c4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw 6gt',
     'model': '6gt',
     'odometer': 200064,
     'odometer_in_km': 200064,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-01',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw 6gt 2.0 620d gran turismo 120kw auto',
     'transmission': 'automatic',
     'trim': '2.0 620d gran turismo 120kw auto',
     'vin': None,
     'year': 2020}
2026-01-28 20:22:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 0f98b969-e4e6-5ecc-b120-67628ea779c4 spider: ayvens.be
2026-01-28 20:22:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: 0f98b969-e4e6-5ecc-b120-67628ea779c4 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'unknown', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'make': 'bmw', 'model': '6gt', 'trim': '2.0 620d gran turismo 120kw auto', 'title': 'bmw 6gt 2.0 620d gran turismo 120kw auto', 'price': 0, 'odometer': 200064, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-01', 'year': 2020, 'fuel_type': 'diesel', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134', 'expiration_date': '2026-01-29t13:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '2.0l', 'c_o_2_emission_value': None, 'origin_country_code': 'be', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '0f98b969-e4e6-5ecc-b120-67628ea779c4', 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'bmw 6gt', 'sanitized_make': 'bmw', 'odometer_in_km': 200064}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 61,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'unknown',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'engine': '2.0l',
     'expiration_date': '2026-01-29t13:00:00z',
     'fuel_type': 'diesel',
     'id': '0f98b969-e4e6-5ecc-b120-67628ea779c4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': None,
     'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
     'listing': 'auction',
     'location': None,
     'make': 'bmw',
     'make_model': 'bmw 6gt',
     'model': '6gt',
     'odometer': 200064,
     'odometer_in_km': 200064,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'be',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-12-01',
     'sanitized_make': 'bmw',
     'seats_number': 5,
     'seller_name': None,
     'title': 'bmw 6gt 2.0 620d gran turismo 120kw auto',
     'transmission': 'automatic',
     'trim': '2.0 620d gran turismo 120kw auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '0f98b969-e4e6-5ecc-b120-67628ea779c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': '6GT',
 'odometer': 200064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6GT 2.0 620D GRAN TURISMO 120KW AUTO',
 'transmission': 'automatic',
 'trim': '2.0 620D GRAN TURISMO 120KW AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877139%27 HTTP/1.1" 200 None
2026-01-28 20:22:42 [ayvens.be] INFO: Saving data for 1877139: {'auction_closing_time': 1769691600.0, 'created_time': 1769545323.403296, 'last_price_update_time': 1769631762.985167}
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877139') HTTP/1.1" 204 0
2026-01-28 20:22:43 [ayvens.be] INFO: Found listing with ID: 1877140
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877140%27 HTTP/1.1" 200 None
2026-01-28 20:22:43 [ayvens.be] INFO: Scrape type for 1877140: 2
2026-01-28 20:22:43 [ayvens.be] INFO: Extracting data for car ID: 1877140
2026-01-28 20:22:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeebb139-be3b-5234-8ef6-e1d136c74ba5 with identifier: 1877140
2026-01-28 20:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeebb139-be3b-5234-8ef6-e1d136c74ba5 with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeebb139-be3b-5234-8ef6-e1d136c74ba5 with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: eeebb139-be3b-5234-8ef6-e1d136c74ba5, identifier: 1877140
2026-01-28 20:22:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: eeebb139-be3b-5234-8ef6-e1d136c74ba5 with identifier: 1877140
2026-01-28 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: eeebb139-be3b-5234-8ef6-e1d136c74ba5 with identifier: 1877140
2026-01-28 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 115709 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    115709
2026-01-28 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: eeebb139-be3b-5234-8ef6-e1d136c74ba5 spider: ayvens.be
2026-01-28 20:22:43 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.be, Dropping listing: eeebb139-be3b-5234-8ef6-e1d136c74ba5 due to rule: high_mileage_for_make.json, error: 115709 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    115709
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'electric',
 'id': 'eeebb139-be3b-5234-8ef6-e1d136c74ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'TESLA',
 'model': 'MODEL 3',
 'odometer': 115709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'TESLA MODEL 3 75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'transmission': 'automatic',
 'trim': '75 KWH LONG RANGE DUAL MOTOR 4WD AUTO',
 'vin': None,
 'year': 2020}
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877140%27 HTTP/1.1" 200 None
2026-01-28 20:22:43 [ayvens.be] INFO: Saving data for 1877140: {'auction_closing_time': 1769691600.0, 'created_time': 1769545306.530212, 'last_price_update_time': 1769631763.319981}
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877140') HTTP/1.1" 204 0
2026-01-28 20:22:43 [ayvens.be] INFO: Found listing with ID: 1877141
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877141%27 HTTP/1.1" 200 None
2026-01-28 20:22:43 [ayvens.be] INFO: Scrape type for 1877141: 2
2026-01-28 20:22:43 [ayvens.be] INFO: Extracting data for car ID: 1877141
2026-01-28 20:22:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a761e8-7805-5463-a15c-ed33caa093ef with identifier: 1877141
2026-01-28 20:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a761e8-7805-5463-a15c-ed33caa093ef with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a761e8-7805-5463-a15c-ed33caa093ef with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 26a761e8-7805-5463-a15c-ed33caa093ef, identifier: 1877141
2026-01-28 20:22:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 26a761e8-7805-5463-a15c-ed33caa093ef with identifier: 1877141
2026-01-28 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 26a761e8-7805-5463-a15c-ed33caa093ef with identifier: 1877141
2026-01-28 20:22:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 26a761e8-7805-5463-a15c-ed33caa093ef with identifier: 1877141 to the API
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'electric',
 'id': '26a761e8-7805-5463-a15c-ed33caa093ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'AUDI',
 'model': 'Q8 E-TRON',
 'odometer': 41879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'AUDI Q8 E-TRON BEV 114KWH 55 QUATTRO ADVANCED',
 'transmission': 'automatic',
 'trim': 'BEV 114KWH 55 QUATTRO ADVANCED',
 'vin': None,
 'year': 2023}
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877141%27 HTTP/1.1" 200 None
2026-01-28 20:22:43 [ayvens.be] INFO: Saving data for 1877141: {'auction_closing_time': 1769691600.0, 'created_time': 1769545319.664838, 'last_price_update_time': 1769631763.706763}
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877141') HTTP/1.1" 204 0
2026-01-28 20:22:43 [ayvens.be] INFO: Found listing with ID: 1877142
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877142%27 HTTP/1.1" 200 None
2026-01-28 20:22:43 [ayvens.be] INFO: Scrape type for 1877142: 2
2026-01-28 20:22:43 [ayvens.be] INFO: Extracting data for car ID: 1877142
2026-01-28 20:22:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56df51bc-1143-5cc6-ab43-a3626e326d90 with identifier: 1877142
2026-01-28 20:22:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56df51bc-1143-5cc6-ab43-a3626e326d90 with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56df51bc-1143-5cc6-ab43-a3626e326d90 with scrape type 2
2026-01-28 20:22:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 56df51bc-1143-5cc6-ab43-a3626e326d90, identifier: 1877142
2026-01-28 20:22:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 56df51bc-1143-5cc6-ab43-a3626e326d90 with identifier: 1877142
2026-01-28 20:22:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 56df51bc-1143-5cc6-ab43-a3626e326d90 with identifier: 1877142
2026-01-28 20:22:43 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 56df51bc-1143-5cc6-ab43-a3626e326d90 with identifier: 1877142 to the API
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.3L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'petrol',
 'id': '56df51bc-1143-5cc6-ab43-a3626e326d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'A-CLASS LIMOUSINE',
 'odometer': 39170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ A-CLASS LIMOUSINE 1.3 A 250 E BUSINESS SOLUTION DCT',
 'transmission': 'automatic',
 'trim': '1.3 A 250 E BUSINESS SOLUTION DCT',
 'vin': None,
 'year': 2022}
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877142%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Saving data for 1877142: {'auction_closing_time': 1769691600.0, 'created_time': 1769545317.657665, 'last_price_update_time': 1769631764.105501}
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877142') HTTP/1.1" 204 0
2026-01-28 20:22:44 [ayvens.be] INFO: Found listing with ID: 1877143
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877143%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Scrape type for 1877143: 2
2026-01-28 20:22:44 [ayvens.be] INFO: Extracting data for car ID: 1877143
2026-01-28 20:22:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c601bb-b3b9-5496-acd8-57519f98c635 with identifier: 1877143
2026-01-28 20:22:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c601bb-b3b9-5496-acd8-57519f98c635 with scrape type 2
2026-01-28 20:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c601bb-b3b9-5496-acd8-57519f98c635 with scrape type 2
2026-01-28 20:22:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 16c601bb-b3b9-5496-acd8-57519f98c635, identifier: 1877143
2026-01-28 20:22:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 16c601bb-b3b9-5496-acd8-57519f98c635 with identifier: 1877143
2026-01-28 20:22:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 16c601bb-b3b9-5496-acd8-57519f98c635 with identifier: 1877143
2026-01-28 20:22:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 16c601bb-b3b9-5496-acd8-57519f98c635 with identifier: 1877143 to the API
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'diesel',
 'id': '16c601bb-b3b9-5496-acd8-57519f98c635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'MERCEDES-BENZ',
 'model': 'GLC',
 'odometer': 108920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MERCEDES-BENZ GLC 2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'transmission': 'automatic',
 'trim': '2.0 GLC 300 DE 4MATIC 4WD BUS SOL AUTO',
 'vin': None,
 'year': 2021}
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877143%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Saving data for 1877143: {'auction_closing_time': 1769691600.0, 'created_time': 1769545333.307404, 'last_price_update_time': 1769631764.521678}
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877143') HTTP/1.1" 204 0
2026-01-28 20:22:44 [ayvens.be] INFO: Found listing with ID: 1877144
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877144%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Scrape type for 1877144: 0
2026-01-28 20:22:44 [ayvens.be] INFO: Found listing with ID: 1877145
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877145%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Scrape type for 1877145: 0
2026-01-28 20:22:44 [ayvens.be] INFO: Found listing with ID: 1877146
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877146%27 HTTP/1.1" 200 None
2026-01-28 20:22:44 [ayvens.be] INFO: Scrape type for 1877146: 0
2026-01-28 20:22:44 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-01-28 20:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877147
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877147%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877147: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877148
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877148%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877148: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877149
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877149%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877149: 2
2026-01-28 20:22:50 [ayvens.be] INFO: Extracting data for car ID: 1877149
2026-01-28 20:22:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b54afe6-271f-5393-91db-21f5e8665e00 with identifier: 1877149
2026-01-28 20:22:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b54afe6-271f-5393-91db-21f5e8665e00 with scrape type 2
2026-01-28 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b54afe6-271f-5393-91db-21f5e8665e00 with scrape type 2
2026-01-28 20:22:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.be, Processed item id: 7b54afe6-271f-5393-91db-21f5e8665e00, identifier: 1877149
2026-01-28 20:22:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.be, Translating item: 7b54afe6-271f-5393-91db-21f5e8665e00 with identifier: 1877149
2026-01-28 20:22:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.be, Applying rules to item: 7b54afe6-271f-5393-91db-21f5e8665e00 with identifier: 1877149
2026-01-28 20:22:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.be, Posting item: 7b54afe6-271f-5393-91db-21f5e8665e00 with identifier: 1877149 to the API
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:22:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'expiration_date': '2026-01-29T13:00:00Z',
 'fuel_type': 'electric',
 'id': '7b54afe6-271f-5393-91db-21f5e8665e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': None,
 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39134',
 'listing': 'auction',
 'location': None,
 'make': 'BMW',
 'model': 'I4',
 'odometer': 29389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW I4 BEV EDRIVE40 GRAN COUPE',
 'transmission': 'automatic',
 'trim': 'BEV EDRIVE40 GRAN COUPE',
 'vin': None,
 'year': 2024}
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877149%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Saving data for 1877149: {'auction_closing_time': 1769691600.0, 'created_time': 1769545366.166532, 'last_price_update_time': 1769631770.748828}
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.be',RowKey='1877149') HTTP/1.1" 204 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877150
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877150%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877150: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877151
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877151%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877151: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877152
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877152%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877152: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877153
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877153%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877153: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877154
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877154%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877154: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877155
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877155%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877155: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877156
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877156%27 HTTP/1.1" 200 None
2026-01-28 20:22:50 [ayvens.be] INFO: Scrape type for 1877156: 0
2026-01-28 20:22:50 [ayvens.be] INFO: Found listing with ID: 1877157
2026-01-28 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877157%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877157: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877158
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877158%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877158: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877159
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877159%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877159: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877160
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877160%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877160: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877161
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877161%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877161: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877162
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877162%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877162: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877163
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877163%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877163: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877164
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877164%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877164: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877165
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877165%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877165: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877166
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877166%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877166: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877167
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877167%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877167: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877168
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877168%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877168: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877169
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877169%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877169: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877170
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877170%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877170: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877171
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877171%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877171: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877172
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877172%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877172: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877173
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877173%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877173: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877174
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877174%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877174: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877175
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877175%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877175: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877176
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877176%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877176: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877177
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877177%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877177: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877178
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877178%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877178: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877179
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877179%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877179: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877180
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877180%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877180: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877181
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877181%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877181: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877182
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877182%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877182: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877183
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877183%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877183: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877184
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877184%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877184: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877185
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877185%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877185: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877186
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877186%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877186: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877187
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877187%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877187: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877188
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877188%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877188: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877189
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877189%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877189: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877190
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877190%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877190: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877191
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877191%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877191: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877192
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877192%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877192: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877193
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877193%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877193: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877194
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877194%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877194: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877195
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877195%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877195: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877196
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877196%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877196: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877197
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877197%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877197: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877198
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877198%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877198: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877199
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877199%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877199: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877200
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877200%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877200: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877201
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877201%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877201: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877202
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877202%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877202: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877203
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877203%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877203: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877204
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877204%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877204: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877205
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877205%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877205: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877206
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877206%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877206: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877207
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877207%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877207: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877208
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877208%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877208: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877209
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877209%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877209: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877210
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877210%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877210: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877211
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877211%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877211: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877212
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877212%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877212: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877213
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877213%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877213: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877214
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877214%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877214: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877215
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877215%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877215: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877216
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877216%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877216: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877217
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877217%27 HTTP/1.1" 200 None
2026-01-28 20:22:51 [ayvens.be] INFO: Scrape type for 1877217: 0
2026-01-28 20:22:51 [ayvens.be] INFO: Found listing with ID: 1877218
2026-01-28 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877218%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877218: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877219
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877219%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877219: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877220
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877220%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877220: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877221
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877221%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877221: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877222
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877222%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877222: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877223
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877223%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877223: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877224
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877224%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877224: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877225
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877225%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877225: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877226
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877226%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877226: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877227
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877227%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877227: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877228
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877228%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877228: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877229
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877229%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877229: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877230
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877230%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877230: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877231
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877231%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877231: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877232
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877232%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877232: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877233
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877233%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877233: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877234
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877234%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877234: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877235
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877235%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877235: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877236
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877236%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877236: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877237
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877237%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877237: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877238
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877238%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877238: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877239
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877239%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877239: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877240
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877240%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877240: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877241
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877241%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877241: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877242
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877242%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877242: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877243
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877243%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877243: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877244
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877244%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877244: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877245
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877245%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877245: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Found listing with ID: 1877246
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877246%27 HTTP/1.1" 200 None
2026-01-28 20:22:52 [ayvens.be] INFO: Scrape type for 1877246: 0
2026-01-28 20:22:52 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-01-28 20:22:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877247
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877247%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877247: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877248
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877248%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877248: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877249
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877249%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877249: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877250
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877250%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877250: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877251
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877251%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877251: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877252
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877252%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877252: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877253
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877253%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877253: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877254
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877254%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877254: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877255
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877255%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877255: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877256
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877256%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877256: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877257
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877257%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877257: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877258
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877258%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877258: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877259
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877259%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877259: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877260
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877260%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877260: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877261
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877261%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877261: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877262
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877262%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877262: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877263
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877263%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877263: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877264
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877264%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877264: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877265
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877265%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877265: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877266
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877266%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877266: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877267
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877267%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877267: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877268
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877268%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877268: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877269
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877269%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877269: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877270
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877270%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877270: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877271
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877271%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877271: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877272
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877272%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877272: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877273
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877273%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877273: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877274
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877274%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877274: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877275
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877275%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877275: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877276
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877276%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877276: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877277
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877277%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877277: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877278
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877278%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877278: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877279
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877279%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877279: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877280
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877280%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877280: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877281
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877281%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877281: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877282
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877282%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877282: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877283
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877283%27 HTTP/1.1" 200 None
2026-01-28 20:22:54 [ayvens.be] INFO: Scrape type for 1877283: 0
2026-01-28 20:22:54 [ayvens.be] INFO: Found listing with ID: 1877284
2026-01-28 20:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877284%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877284: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877285
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877285%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877285: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877286
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877286%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877286: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877287
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877287%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877287: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877288
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877288%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877288: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877289
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877289%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877289: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877290
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877290%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877290: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877291
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877291%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877291: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877292
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877292%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877292: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877293
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877293%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877293: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877294
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877294%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877294: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877295
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877295%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877295: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877296
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877296%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877296: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877297
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877297%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877297: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877298
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877298%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877298: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877299
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877299%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877299: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877300
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877300%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877300: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877301
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877301%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877301: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877302
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877302%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877302: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877303
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877303%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877303: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877304
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877304%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877304: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877305
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877305%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877305: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877306
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877306%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877306: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877307
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877307%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877307: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877308
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877308%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877308: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877309
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877309%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877309: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877310
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877310%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877310: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877311
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877311%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877311: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877312
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877312%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877312: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877313
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877313%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877313: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877314
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877314%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877314: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877315
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877315%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877315: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877316
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877316%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877316: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877317
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877317%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877317: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877318
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877318%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877318: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877319
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877319%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877319: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877320
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877320%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877320: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877321
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877321%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877321: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877322
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877322%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877322: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877323
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877323%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877323: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877324
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877324%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877324: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877325
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877325%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877325: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877326
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877326%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877326: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877327
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877327%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877327: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877328
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877328%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877328: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877329
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877329%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877329: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877330
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877330%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877330: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877331
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877331%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877331: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877332
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877332%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877332: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877333
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877333%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877333: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877334
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877334%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877334: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877335
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877335%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877335: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877336
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877336%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877336: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877337
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877337%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877337: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877338
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877338%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877338: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877339
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877339%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877339: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877340
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877340%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877340: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877341
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877341%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877341: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877342
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877342%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877342: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877343
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877343%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877343: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877344
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877344%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877344: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877345
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877345%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877345: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Found listing with ID: 1877346
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877346%27 HTTP/1.1" 200 None
2026-01-28 20:22:55 [ayvens.be] INFO: Scrape type for 1877346: 0
2026-01-28 20:22:55 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-01-28 20:22:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877347
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877347%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877347: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877348
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877348%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877348: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877349
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877349%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877349: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877350
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877350%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877350: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877351
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877351%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877351: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877352
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877352%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877352: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877353
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877353%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877353: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877354
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877354%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877354: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877355
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877355%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877355: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877356
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877356%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877356: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877357
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877357%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877357: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877358
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877358%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877358: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877359
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877359%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877359: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877360
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877360%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877360: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877361
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877361%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877361: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1877362
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271877362%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1877362: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1869765
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869765%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1869765: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1869766
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869766%27 HTTP/1.1" 200 None
2026-01-28 20:22:57 [ayvens.be] INFO: Scrape type for 1869766: 0
2026-01-28 20:22:57 [ayvens.be] INFO: Found listing with ID: 1869767
2026-01-28 20:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869767%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869767: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869768
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869768%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869768: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869769
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869769%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869769: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869770
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869770%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869770: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869771
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869771%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869771: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869772
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869772%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869772: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869773
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869773%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869773: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869774
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869774%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869774: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869775
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869775%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869775: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869776
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869776%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869776: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869777
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869777%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869777: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869778
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869778%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869778: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869779
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869779%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869779: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869780
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869780%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869780: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869781
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869781%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869781: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869782
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869782%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869782: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869783
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869783%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869783: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869784
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869784%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869784: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869785
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869785%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869785: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869786
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869786%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869786: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869787
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869787%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869787: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869788
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869788%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869788: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869789
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869789%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869789: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869790
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869790%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869790: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869791
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869791%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869791: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869792
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869792%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869792: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869793
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869793%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869793: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869794
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869794%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869794: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869795
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869795%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869795: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869796
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869796%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869796: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869797
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869797%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869797: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869798
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869798%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869798: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869799
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869799%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869799: 0
2026-01-28 20:22:58 [ayvens.be] INFO: Found listing with ID: 1869800
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869800%27 HTTP/1.1" 200 None
2026-01-28 20:22:58 [ayvens.be] INFO: Scrape type for 1869800: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869801
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869801%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869801: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869802
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869802%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869802: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869803
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869803%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869803: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869804
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869804%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869804: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869805
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869805%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869805: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869806
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869806%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869806: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869807
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869807%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869807: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869808
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869808%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869808: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869809
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869809%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869809: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869810
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869810%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869810: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869811
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869811%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869811: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869812
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869812%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869812: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869813
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869813%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869813: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869814
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869814%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869814: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869815
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869815%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869815: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869816
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869816%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869816: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869817
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869817%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869817: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869818
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869818%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869818: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869819
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869819%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869819: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869820
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869820%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869820: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869821
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869821%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869821: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869822
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869822%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869822: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869823
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869823%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869823: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869824
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869824%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869824: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869825
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869825%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869825: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869826
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869826%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869826: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869827
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869827%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869827: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869828
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869828%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869828: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869829
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869829%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869829: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869830
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869830%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869830: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869831
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869831%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869831: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869832
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869832%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869832: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869833
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869833%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869833: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869834
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869834%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869834: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869835
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869835%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869835: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869836
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869836%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869836: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869837
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869837%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869837: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869838
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869838%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869838: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869839
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869839%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869839: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869840
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869840%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869840: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869841
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869841%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869841: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869842
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869842%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869842: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869843
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869843%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869843: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Found listing with ID: 1869844
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20RowKey%20eq%20%271869844%27 HTTP/1.1" 200 None
2026-01-28 20:22:59 [ayvens.be] INFO: Scrape type for 1869844: 0
2026-01-28 20:22:59 [ayvens.be] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-01-28 20:22:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:23:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 20:23:01 [ayvens.be] INFO: ayvens.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 293}
2026-01-28 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:23:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.be%27%20and%20last_price_update_time%20lt%201769199781 HTTP/1.1" 200 None
2026-01-28 20:23:01 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (247 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.be/task_72_2026-01-28T20_00_00.jl
2026-01-28 20:23:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 1,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 1,
 'downloader/request_bytes': 1545467,
 'downloader/request_count': 3320,
 'downloader/request_method_count/GET': 3311,
 'downloader/request_method_count/POST': 9,
 'downloader/response_bytes': 1834305318,
 'downloader/response_count': 3319,
 'downloader/response_status_count/200': 3319,
 'elapsed_time_seconds': 1373.712746,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 20, 23, 1, 389177, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 210,
 'item_dropped_reasons_count/DropItem': 210,
 'item_scraped_count': 247,
 'log_count/DEBUG': 37811,
 'log_count/INFO': 36637,
 'memusage/max': 184061952,
 'memusage/startup': 126939136,
 'photo_download_count': 3309,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 134,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 130,
 'playwright/request_count/method/POST': 4,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 1,
 'playwright/request_count/resource_type/font': 16,
 'playwright/request_count/resource_type/image': 29,
 'playwright/request_count/resource_type/script': 80,
 'playwright/request_count/resource_type/stylesheet': 1,
 'playwright/request_count/resource_type/xhr': 5,
 'playwright/response_count': 117,
 'playwright/response_count/method/GET': 114,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 1,
 'playwright/response_count/resource_type/font': 16,
 'playwright/response_count/resource_type/image': 14,
 'playwright/response_count/resource_type/script': 79,
 'playwright/response_count/resource_type/stylesheet': 1,
 'playwright/response_count/resource_type/xhr': 4,
 'request_depth_max': 9,
 'response_received_count': 10,
 'scheduler/dequeued': 3320,
 'scheduler/dequeued/memory': 3320,
 'scheduler/enqueued': 3320,
 'scheduler/enqueued/memory': 3320,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 9,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.9767075750148964,
 'scrapy-zyte-api/mean_response_seconds': 3.079695544205606,
 'scrapy-zyte-api/processed': 9,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 9,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 9,
 'scrapy-zyte-api/request_args/httpRequestBody': 9,
 'scrapy-zyte-api/request_args/httpRequestMethod': 9,
 'scrapy-zyte-api/request_args/httpResponseBody': 9,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 9,
 'scrapy-zyte-api/request_args/url': 9,
 'scrapy-zyte-api/status_codes/200': 9,
 'scrapy-zyte-api/success': 9,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 20, 0, 7, 676431, tzinfo=datetime.timezone.utc)}
2026-01-28 20:23:01 [scrapy.core.engine] INFO: Spider closed (finished)